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20.  abstract. 

training  trials;  nasslng  or  distributing  practice  has  little  effect;  reducing 
control  processing  resources  slows  learning;  antoaiatlc  processes  can  bee one 
context  dependent;  training  operators  to  respond  to  classes  of  ewents 
pronotes  generalisation  of  autonatlc  processing:  dual  task  neasures  are 
Inportsnt  assessawnt  tools  In  assessing  skill  eenpetency;  and  notlwational 
characteristics  of  training  progrsns  greatly  influence  training  success  rates. 
Autonatlc  processes  Influence  perfomanee  In  ccnplex  category  search  tasks, 
inconsistent  tasks  with  consistent  coaiponents,  tasks  which  are  consistent 
within  a  context,  wlsual  spatial  tanporal  pattern  tasks,  and  conjunction  of 
features  tasks.  Autonatlc  processing  Is  wery  reliable  and  can  perfom  conplex 
functions,  such  as  category  search,  with  no  neasurable  increase  in  workload.  . 

The  inaensitiwity  of  autonatlc  processing  to  the  effects  of  notlwatlon, 
vigilance,  and  drugs,  and  the  stability  over  long  periods  without  practice, 
suggest  the  need  to  train  autonatlc  conponent  skills  to  obtain  high  porfomsneii 
skill  levdils.  Individual  dlfforences  In  terns  of  anount  of  control  processing 
resources,  speed  of  autonatlc  process  developnont,  ability  to  deal  with 
frustrations  Inherent  In  practicing  a  skill,  ability  to  incorporate  context 
control,  and  the  ability  to  "let  go"  of  an  autonatlc  process  nay  influence 
training  progran  snccess.  Eleven  guidelines  are  presented  for  speeding 
autonatlc  process  developnent  In  training  prograns.  These  guidelines  can  be 
incorporated  into  nicroprocessor  based  skill  trainers  and  nay  substantially 
Inrpove  training  effectiveness .  An  application  of  the  guidelines  to  the 
training  of  air  traffic  control  for  Inflict  refueling  Is  presented.  The 
proposed  progran  presents  a  nunber  of  novel  approaches  to  training  radar 
control  tasks.  The  analysis  of  the  air  traffic  control  task  illustrates 
how  autonatlc  and  controlled  processes  Interact  to  perfom  conplex  operations. 
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Automatfc/Control led  Processing  Concepts 
and  Their  Implications  for  the  Training  of  Skills 

Final  Report 
Walter  Schneider 
Abstract 

Recent  research  on  automatic  and  controlled  processing  Is  reviewed  with  emphasis 
on  the  Implications  for  applied  training  programs  and  personnel  selection.  The 
research  assumes  that  humans  perform  mental  operations  through  the  Interaction 
between  slow,  effortful,  easy  to  modify  controlled  processing  and  comparatively 
fast,  parallel,  difficult  to  train  automatic  processing.  Major  conclusions  from 
the  work  include:  performance  Improves  as  a  function  of  consistent  correct 

executions;  automatic  processes  can  develop  with  few  training  trials;  massing  or 
distributing  practice  has  little  effect;  reducing  control  processing  resources 
slows  learning;  automatic  processes  can  become  context  dependent;  training 
operators  to  respond  to  classes  of  events  promotes  general izatlon  of  automatic 
processing;  dual  task  measures  are  Important  assessment  tools  In  assessing  skill 
competency;  and  motivational  characteristics  of  training  programs  may  greatly 
Influence  training  success  rates.  Automatic  processes  influence  performance  In 
complex  category  search  tasks.  Inconsistent  tasks  with  consistent  components, 
tasks  which  are  consistent  within  a  context,  visual  spatial  temporal  pattern 
tasks,  and  conjunction  of  features  tasks.  Automatic  processing  Is  very  reliable 
and  can  perform  complex  functions,  such  as  category  search,  with  no  measurable 
Increase  In  workload.  The  Insensitivity  of  automatic  processing  to  the  effects 
of  motivation,  vigilance,  and  drugs,  and  the  stability  over  long  periods  without 
practice,  suggest  the  need  to  train  automatic  component  skills  to  obtain  high 
performance  levels.  Individual  differences  In  terms  of  amount  of  control 
processing  resources,  speed  of  automatic  process  development,  ability  to  deal 
with  frustrations  Inherent  In  practicing  a  skill,  ability  to  Incorporate  context 
control,  and  the  ability  to  "let  go"  of  an  automatic  process  may  Influence 
training  program  success.  Eleven  guidelines  are  presented  for  speeding 
automatic  process  development  in  training  programs.  These  guidel Ines  can  be 
Incorporated  into  microprocessor  based  skill  trainers  and  may  substantially 
Improve  training  effectiveness.  An  application  of  the  guidelines  to  the 
training  of  alr-trafflc  control  for  Inflight  refueling  Is  presented.  The 
proposed  program  presents  a  number  of  novel  approaches  to  training  radar  control 
tasks.  The  analysis  of  the  alr-trafflc  control  tasks  Illustrates  how  automatic 
and  controlled  processes  Interact  to  perform  complex  operations. 
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Automatic/Control  led  Processing  Concepts 
and  Their  Implications  for  the  Training  of  Skills 

Final  Report 

This  report  summarizes  the  research  carried  out  on  Contract 
N000014-78-C-0012.  This  research  examines  human  Information  processing  In 
skilled  performance.  The  research  Interprets  human  Information  processing  to  be 
the  result  of  two  qualitatively  different  processes:  controlled  and  automatic 
Information  processing.  Controlled  processing  requires  little  training  to 
Initiate,  Is  easy  to  modify,  but  slow,  serial  In  nature,  and  highly  dependent  on 
load.  Automatic  processing  Is  a  very  fast,  parallel  processing  mode  which 
occurs  after  subjects  are  extensively  trained  at  treating  Information  In  a 
consistent  manner.  The  objectives  of  the  research  program  are  to  determine  how 
to  quickly  develop  skilled  behaviors,  determine  the  limits  of  automatic 
processing  capabilities.  Improve  the  theory  of  Individual  difference  testing  and 
assessment,  and  suggest  guidelines  for  equipment  and  training  programs  to 
optimize  automatic  processing  performance. 

The  present  report  Is  a  summary  of  the  research  project  results  and  some 
speculations  about  their  Implications  for  applied  settings.  Detailed 
Information  about  the  research  is  provided  In  technical  reports  and  working 
papers  listed  on  pages  31-32  of  this  document.  During  this  project  we  have 
trained  subjects  for  a  total  of  over  10,000  hours.  In  this  report  we  will 
discuss  both  the  empirical  evidence  and  our  subjective  Impressions  of  this 
training  experience.  At  the  end  of  this  report  we  will  illustrate  how  the 
principles  derived  from  this  research  might  be  utilized  In  applied  training 
programs.  In  particular  we  will  discuss  how  one  would  develop  automatic 
performance  skills  for  alr-traffic  control  of  Inflight  refueling  operations. 
There  Is  a  wide  variety  of  material  presented  In  this  report.  Readers  are 
encouraged  to  skim  sections  attending  to  underlined  comments  If  pressed  for 
time. 


Background 

Human  performance  In  almost  any  cognitive  or  motor  skill  shows  profound 
changes  with  practice.  Consider  the  changes  that  occur  while  learning  to  fly  an 
aircraft,  type,  play  a  musical  Instrument,  read,  or  play  tennis.  At  first, 
effort  and  attention  must  be  devoted  to  every  movement  or  minor  decision,  thus 
performance  Is  slow  and  error  prone.  Eventually  long  sequences  of  movements  or 
cognitive  acts  can  be  carried  out  with  little  attention,  and  performance  Is 
quite  rapid  and  accurate.  For  example,  the  beginning  reader  may  need  a  few 
seconds  to  encode  each  new  letter,  and  still  may  be  error  prone,  whereas  the 
expert  can  accurately  encode  25  letters  per  second  and  still  have  sufficient 
capacity  available  to  encode  the  material  semantically  as  well.  In  aircraft 
control,  the  novice  may  have  difficulty  Just  keeping  his  aircraft  on  the  proper 
heading.  However  the  expert  can  fly  complex  aircraft  formation  maneuvers  while 
performing  a  simultaneous  digit  cancelling  task  (Col le  &  DeMalo,  1978). 

The  striking  changes  that  occur  with  practice  have  led  many  researchers  to 
propose  that  there  are  two  qualitatively  different  forms  of  human  processing 
(e.g.,  James,  1890;  LaBerge,  1973;  Posner  &  Snyder,  1975;  Shiffrin  &  Schneider, 
1977).  I  shall  refer  to  these  two  processes  as  automatic  and  controlled 
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processing.  Automatic  processing  Is  a  fast  parallel  process,  not  limited  by 
short-term  memory,  requires  little  subject  effort,  requires  extensive  and 
consistent  training  to  develop,  and  provides  little  direct  subject  control. 
Manipulating  a  fork  at  dinner  or  driving  a  car  are  examples  of  automatic 
processes.  Controlled  processing  Is  comparatively  slow,  serial,  limited  by 
short-term  memory,  and  requires  subject  effort,  exhibits  a  large  degree  of 
subject  control,  and  requires  little  or  no  training  to  develop.  In  addition, 
control  processing  appears  to  be  Instrumental  in  causing  substantial  changes  In 
long-term  memory.  Trying  to  remember  a  telephone  number  long  enough  to  dial  It 
Is  an  example  of  a  control  process. 

Development  of  skilled  performance  Is  primarily  the  result  of  developing 
appropriate  automatic  processes  (see  Report  8002;  Schneider  &  Fisk,  In  press-b). 
Control  processing  resources  are  limited  (e.g.,  one  can  only  maintain  5  Items  In 
memory),  and  do  not  Improve  with  practice  (see  Schneider,  Duma  Is,  &  Shiffrin,  In 
press).  Our  research  suggests  that  skilled  performance  results  from  building  up 
many  component  automatic  processes  which  perform  consistent  processing 
transformations  In  complex  tasks. 

The  reader  should  note,  however,  that  the  performance  of  all  skilled  tasks 
involves  the  Interaction  of  both  processes.  Even  brief  consideration  of  any 
complex  task,  such  as  playing  tennis,  makes  It  clear  that  such  tasks  are  carried 
out  by  a  mixture  of  automatic  and  control  processes,  possibly  organized  In  a 
systematic  network  or  hierarchy  with  many  of  the  automatic  processes  operating 
In  parallel.  The  control  processes  deal  with  strategy  (e.g.,  seeking  for 
advantage  or  trying  to  tire  the  opponent),  maintain  temporary  Information  (e.g., 
current  point  advantage  In  the  game),  and  deal  with  any  novel  components  of  the 
task  (e.g.,  particular  wind  conditions).  Operating  within  the  context  of  the 
Information  maintained  by  control  processes,  automatic  processes  perform  the 
consistent  elements  of  the  task  (e.g.,  approaching  and  hitting  the  ball).  The 
following  discussion  will  occasionally  refer  to  the  processes  Involved  In 
carrying  out  a  task  as  If  they  were  wholly  automatic  or  controlled.  In  all  such 
cases  the  reader  should  understand  that  these  statements  are  designed  to 
simplify  the  discussion;  the  Intended  referent  will  always  be  some  major 
component  process.  We  assume  as  a  working  hypothesis  that  essentially  all  tasks 
are  accomplished  by  a  mixture  of  both  types  of  processes. 

Speeding  Development  of  Automatic  Processes 

The  major  effort  during  this  contract  period  has  been  to  determine  how  to 
speed  up  the  development  rate  of  producing  new  automatic  processes.  We  have 
been  fairly  successful  and  have  reduced  our  training  time  for  a  simple  detection 
task  from  approximately  2,000  trials  of  training  to  below  200  trials.  If  these 
techniques  are  employed  In  developing  automatic  component  skills,  training  time 
could  be  reduced  by  as  much  as  90|  In  a  variety  of  applied  settings.  We  have 
also  shown  that  automatic  performance  Improvements  can  occur  with  as  few  as  10 
practice  trials  (Report  8004).  Hence  automatic  processing  should  not  be  viewed 
as  being  Important  only  after  hours  of  practice. 

Consistency  Is  a.  necessary  condition  Iql  performance  I mprovement  ansi. 
automatic  process  development  (see  Report  8005;  Schneider  &  Fisk,  1982).  In  a 
detection  paradigm,  subjects  were  required  to  detect  specific  letters  In  rapidly 
(I.e.,  110  msec  each)  presented  frames  of  4  letters.  In  a  consistently  mapped 
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(CM)  condition,  every  time  a  particular  letter  would  occur  the  subject  would 
respond  Indicating  the  position  of  that  letter.  In  a  varied  mapping  (VM) 
condition,  on  sore  trials  the  subject  would  respond  to  that  letter,  on  other 
trials  the  letter  would  be  a  distractor  and  would  be  Ignored.  In  the  VM 
condition  subjects  could  not  consistently  respond  to  the  stimulus  across  trials. 
In  the  CM  condition  subjects*  detection  performance  improved  about  55f  with 
practice  after  670  detection  trials.  However,  If  a  stimulus  letter  appeared  as 
a  distractor  twice  as  often  as  It  appeared  as  a  target,  there  was  no  significant 
performance  improvement  as  a  function  of  practice  (see  Figure  1).  As 
consistency  decreased,  both  the  performance  Improvement  rate  and  the  final 
performance  level  also  decreased.  In  addition,  subjects  were  tested  with  the 
letter  detection  task  treated  as  a  secondary  task.  Results  showed  that  previous 
consistent  mapping  training  greatly  facilitated  the  subjects'  performance  of  the 
detection  task  as  a  secondary  task.  In  fact.  If  the  target's  previous 
consistency  was  less  than  1/3  (i.e.,  a  letter  appeared  as  a  distractor  twice  as 
often  as  It  appeared  as  a  target),  subjects  could  not  detect  any  of  the  targets 
if  the  detection  task  was  treated  as  a  secondary  task.  These  results  Indicate 
that  per-formance  improves  as.  a  muitipi  icative  function  ol  number  ol  trials 

aiuL  the  degree  consistency. 


Insert  Figure  1  about  here 


The  Importance  of  consistency  suggests  that  training  programs  should 
facilitate  the  Identification  of  consistencies  and  consistent  responding.  For 
example,  computer  assisted  displays  might  emphasize  the  consistent  events 
appropriate  for  a  particular  task.  In  our  alr-traffic  control  task,  we  present 
the  consistent  control  function  curves  which  are  representative  of  the  turn 
characteristics  of  the  aircraft  the  operators  would  control  (see  below). 
Adaptive  training  techniques  might  also  promote  consistency.  Such  techniques 
should  not  Increase  the  difficulty  of  the  task-  beyond  the  point  where  operators 
are  at  least  50f  accurate.  Otherwise  we  would  predict  that  responding  would  not 
be  consistent  enough  to  develop  automatic  processes  to  perform  the  task. 

Performance  Improvement  appears  primarily  a  function  fit  COrrflCt 
exacut I ons  of  the  process.  In  a  search  paradigm  (Report  8004)  we  found  that 
detection  performance  Improved  as  a  function  of  the  number  of  correct 
detections.  Performance  did  not  improve  as  a  function  of  searching  for  a  letter 
and  not  detecting  It.  In  fact,  performance  decreased  with  nondetection 
searches.  We  speculate  that  performance  Improvement  Is  primarily  a  function  of 
the  number  of  times  the  proper  stimulus  to  response  mapping  was  executed  by 
control  processing.  Searching  without  detecting  does  not  activate  the  stimulus 
response  mapping  and  hence  would  not  be  expected  to  Improve  performance.  Our 
results  suggest  that  when  training  an  observer  one  should  provide  many 
experiences  of  the  critical  event  relative  to  searches  without  the  critical 
event  occurring.  The  effectiveness  of  "guidance"  and  "discovery"  methods  of 
teaching  (see  Wei  ford,  1976,  Chapter  6)  appears  to  be  that  they  reduce  Initial 
errors  and  result  In  the  learner  making  few  Incorrect  executions.  These  methods 
Improve  both  the  consistency  of  response  and  the  number  of  correct  executions. 
Hence  they  would  be  predicted  to  speed  automatic  process  development. 
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Detection  performance  can  Improve  with  as  few  ^  IQ  consistent  training 
trials.  We  found  (Report  8004)  that  after  an  average  of  10.1  consistent 
detections,  performance  Improved  44]^  over  the  comparable  VM  detection  rate.  In 
general  we  find  substantial  Improvements  with  less  than  200  detections  of  a 
letter  In  a  consistent  mapping  search  task. 

Our  results  suggest  (Report  8011)  that  there  may  be  soma  minimal 
consol Idatlon  time  for  developing  an  automatic  process.  When  subjects  are 
trained  with  very  rapidly  presented  stimuli  (I.e.,  at  rates  faster  then  100  msec 
per  stimulus)  we  often  find  subjects  can  consistently  detect  a  target  but 
performance  does  not  Improve  with  practice.  However,  If  the  presentation  rate 
Is  slowed  (I.e.,  from  100  msec  per  stimulus  to  150  msec),  not  only  does 
detection  performance  Improve  but  also  performance  now  significantly  Improves 
with  practice.  This  suggests  that  there  might  be  a  short  (approximately  100 
msec)  consolidation  time  required  for  a  correct  execution  of  an  automatic 
process  to  lead  to  Its  development.  We  are  continuing  research  to  determine 
whether  there  Is  such  a  brief  consolidation  period. 

Our  training  results  suggest  that  moderate  speed  stress  may  Improve 
automatic  process  development  rates.  We  have  observed  subjects  performing  a 
training  task,  sometimes  for  days,  with  little  Improvement  even  though  the  task 
is  such  that  most  subjects  show  substantial  Improvement.  We  have  found  that 
there  Is  little  If  any  performance  Improvement  In  some  subjects  If  they  are  not 
pushed  to  perform  faster.  In  some  subjects  we  have  found  little  performance 
Improvement  even  after  10  sessions  of  CM  training.  However,  with  these  subjects 
we  often  find  that  If  we  push  them  (e.g.,  require  that  they  respond  under  a 
given  deadline  reaction  time),  performance  does  Improve  substantially.  We  have 
trained  subjects  In  both  a  single  frame  and  multiple  frame  procedure.  In  the 
single  frame  procedure  the  subject  Is  presented  a  display  and  required  to 
respond  If  a  target  Is  present  on  the  display.  The  subject  has  as  much  time  as 
he  or  she  wants  to  process  the  display.  Our  second  procedure  Is  a  multiple 
frame  procedure.  In  this  procedure  the  subject  Is  presented  a  rapid  series  of 
displays  for  short  duration  each  (e.g.,  typically  100  msec).  We  have  found 
somewhat  faster  improvement  rates  when  subjects  are  trained  In  the  multiple 
frame  procedure.  We  interpret  this  faster  Improvement  rate  as  suggestive  that 
mild  time  pressure  Improves  subject  learning  rates. 

Massing  versus  dJstrJb.Utlno  practicfl  SBflmS  ±a  iiayfi  IJltla  eftect  fla 
training  rate  within  the  ranges  tested.  In  a  CM  detection  paradigm,  subjects 
searched  for  a  given  letter  at  every  second  trial,  fourth  trial,  or  eighth 
trial.  The  differences  between  these  levels  of  distributed  training  were  not 
significant  (Working  Paper  80-2). 

Reducing  control  processing  resources  appears  Ifi  SiXUL  Ihfi  learning  £alft« 
We  have  carried  out  many  experiments  In  which  subjects  learn  a  detection  task 
while  they  carry  out  a  secondary  task.  Our  subjective  Impression  Is  that  in 
these  training  situations  performance  Improves  much  more  slowly  than  when 
subjects  do  not  need  to  perform  the  secondary  task.  The  careful  examination  of 
Logan's  data  (1978)  also  shows  that  performance  does  not  Improve  as  quickly  when 
subjects  are  under  high  secondary  task  load. 

These  results  suggest  the  obvious,  that  operators  should  not  be  overloaded 
while  trying  to  learn  a  new  task.  This  might  stress  the  Importance  of  part-task 
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training  over  full-task  training.  Although  the  full-task  trainer  might  more 
closely  approximate  performance  on  the  final  task.  It  might  also  overload  the 
operator.  Such  overloading  might  greatly  reduce  learning  rate  and  hence  slow 
learning  In  comparison  to  part-task  training.  This  overloading  Is  usually 
conceived  of  In  terms  of  memory  limitations.  Reed  (1924a,  1924b)  was  the  first 
to  speculate  that  the  part  method  may  be  superior  because  It  adjusted  the 
material  to  be  learned  to  the  memory  span  of  the  subject.  Maccoby,  Michael,  and 
Levine  (1961),  Margollus  and  Sheffield  (1961),  Michael  and  Maccoby  (1961),  and 
Sheffield  (19611  argued  that  a  subject  should  be  presented  with  only  that  amount 
of  Information  which  he  Is  capable  of  "assimilating"  at  a  given  moment.  They 
call  the  capacity  of  the  subject  to  assimilate  a  given  amount  of  the  material 
the  "demonstration-assimilation  span"  (D-A  span)  of  the  subject.  The  amount  of 
the  given  material  that  subjects  are  capable  of  assimilating  at  a  given  moment 
Is  called  the  "demonstration-assimilation  unit"  (D-A  unit).  They  argue  that  the 
optimal  D-A  unit  Is  that  amount  of  material  after  which  the  typical  subject’s 
responses  are  75$  correct  on  a  post-test.  If  the  D-A  units  are  larger  than 
this,  the  authors  argue,  learning  will  be  Impeded;  If  smaller,  learning  will  be 
Inefficient.  In  actual  practice,  the  amount  of  material  presented  at  one  time 
should  be  a  compromise  between  the  logical  or  natural  units  of  the  task  (as 
Identified  by  some  form  of  task  analysis)  and  D-A  units. 

Agtcmatic  process  leflrnJng  max  !)£  substantial ly  influenced  bx  contaxl.  We 
carried  out  a  series  of  12  experiments  (Report  8009)  to  determine  whether 
subjects  could  develop  automatic  processes  which  were  inconsistent  across 
context  but  would  be  consistent  within  a  context.  In  these  experiments,  the 
context  was  manipulated  by  putting  up  a  set  of  context  symbols  (X’s  In  a  diamond 
versus  O’s  In  a  square  formation)  around  the  four  visual  channels.  A  particular 
letter  would  be  consistently  mapped  as  a  target  In  one  context  (e.g.,  X’s  on  the 
display)  and  would  always  be  a  distractor  in  another  context  (O's  on  the 
display).  We  found  in  a  number  of  such  context  dependent  training  situations 
that  some  of  our  subjects  could  clearly  develop  performance  levels  typical  of 
automatic  processing.  Some  subjects  could  detect  a  given  set  of  stimuli  when 
they  were  targets  on  some  trials  and  distractors  on  the  other  as  well  as  when 
they  were  targets  only.  For  some  subjects  providing  explicit  external  context 
Improved  their  ability  to  develop  context  dependent  automatic  processes. 
Additional  research  Is  required.  The  present  results  suggest  that  automatic 
processes  can  develop  when  subjects  must  consistently  respond  to  stimuli  within 
a  given  context;  however,  their  responses  to  the  stimuli  need  not  be  consistent 
across  all  contexts  (see  Schneider  i  Fisk,  in  press-a). 

The  second  set  of  results  suggesting  that  context  Is  Important  Is  our 
experience  In  dual  task  processing  conditions.  In  these  tasks  subjects  are 
asked  to  perform  two  processing  tasks  at  once  (e.g.,  searching  for  letters  while 
keeping  digits  In  short-term  memory).  Every  time  we  change  the  dual  task 
processing  conditions  even  slightly,  subjects  typically  require  one  to  two  hours 
of  training  before  they  can  perform  both  tasks  well.  Logan  (1978,  1979)  has 
observed  a  similar  initial  training  time  for  dual  task  conditions.  We 
speculatively  interpret  this  as  time  In  which  the  automatic  processes  become 
active  within  the  particular  dual  task  context. 

The  military  combat  environment  provides  a  suggestive  example  of  problems 
caused  by  lack  of  context  Incorporation.  It  Is  generally  found  that  pilots  who 
survive  their  first  ten  combat  missions  have  a  greatly  Increased  chance  of 
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surviving  further  missions.  We  would  predict  that  early  missions  would 
Incorporate  previously  learned  automatic  behaviors  such  that  they  would  be 
enabled  within  combat  context.  Unfortunately,  during  the  first  few  missions, 
many  of  the  automatic  behaviors  may  not  transfer  to  the  new  context,  resulting 
In  very  poor  performance. 

The  potential  of  having  automatic  processes  which  are  context  dependent 
suggests  that  training  environments  should  attempt  to  recreate  as  much  of  the 
final  context  as  possible  during  training.  In  training  a  component  task.  It 
would  be  best  to  embed  that  component  within  the  more  complex  task.  For 
example.  In  the  a  I r- Intercept  task  (see  below),  while  the  operator  Is  learning 
to  control  one  aircraft  the  computer  might  also  display  the  performance  of  the 
other  aircraft  for  the  proper  rendezvous.  In  this  way  it  Is  hoped  that  the 
operator  will  learn  the  appropriate  visual  context  under  which  the  various  turn 
characteristics  of  the  aircraft  would  take  place.  One  must  be  cautious  when 
adding  context  not  to  overload  the  operator's  limited  control  processing 
capacities. 

If  automatic  processes  do  become  context  dependent,  there  may  be  some 
situations  where  the  context  should  be  varied  In  training  so  that  the  automatic 
process  Is  context  Independent.  For  example.  If  you  cannot  train  within  the 
actual  context  (e.g.,  a  life  threatening  situation).  It  might  be  best  to  train 
in  a  variety  of  situations  so  that  the  automatic  process  would  not  be  context 
specific.  Since  our  previous  research  has  shown  that  varied  mapping  search 
conditions  do  not  result  In  automatic  process  development,  we  would  anticipate 
that  varying  the  context  could  result  In  context  Independent  automatic 
processes.  This  Is,  of  course,  speculative  at  present. 

To  promote  proper  generalization,  training  may  have  to  be  done  Ulfi 
appropriate  level  of  the  task.  We  have  trained  subjects  to  respond  to  specific 
letters,  words,  and  categories  of  words  (see  Report  8102).  Results  suggest  that 
subjects  can  automatically  respond  at  any  of  these  three  levels  of  stimulus 
generalization.  When  subjects  were  trained  to  respond  at  the  category  level, 
they  were  taught  to  search  for  words  of  a  given  category  but  never  to  search  for 
a  given  Individual  word.  We  speculate  that  If  subjects  consistently  respond  to 
a  single  word,  automatic  processes  will  develop  for  that  specific  word. 
However,  If  there  Is  a  large  set  of  words  that  fall  Into  a  general  category,  and 
subjects  are  responding  to  the  category,  we  expect  the  learning  to  be  at  the 
category  level.  In  an  applied  training  situation,  the  amount  of  emphasis  given 
to  particular  stimulus  readouts  may  be  Important.  For  example.  In  training  a 
nuclear  plant  operator  you  may  train  the  operator  to  respond  either  to  a 
particular  temperature  readout,  or  to  a  contrast  between  one  gauge  and  the  rest 
of  the  gauges.  In  the  former  case  we  would  expect  less  transfer  to  a  variety  of 
similar  events  than  we  would  In  the  latter.  In  the  alr-traffic  control 
situation  (see  below)  we  vary  the  angle  of  the  Incoming  planes  so  the  learner 
does  not  develop  skills  specific  to  one  set  of  Incoming  planes. 

In  some  situations  there  Is  a  need  train  sub Jects  let  automatic 
orocassas  oparate  without  resources.  A  good  typist  knows  the  Importance  of 
letting  automatic  process  typing  behaviors  take  place  without  the  interference 
of  conscious  control  processes.  If  a  typist  thinks  about  his/her  hand 
placements,  the  typing  becomes  more  error  prone.  We  have  found  In  our  dual  task 
training  experiments  that  subjects  have  a  strong  tendency  to  waste  control 
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Flgiir*  2.  Single  and  dual  task  perforMnce  In  a  CM  and  VM  nnltlpla 
fraaa  search  task.  The  f  refers  to  the  duracion  batwaan  displays  in 
■llllsaconds .  The  triangles  represent  CM  search  cendltlens,  the  circles, 
VM  search  conditions.  Pilled  synbols  shw  single  task  perfonaanee,  open 
synbols,  dnal  task  perfomance  idien  hodi  CM  and  VM  search  are  carried  ont 
slanltaneonsly.  Note  the  CM  single  task  condition  reaches  asynptete 
relatively  early  cosipared  to  the  dual  task  conditions.  (Seo  keport  8002 
or  Schneider  &  Fisk,  in  press-a). 
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processing  resources  (see  Report  8002).  After  a  process  was  well  developed  we 
found  that  we  had  to  strongly  encourage  subjects  not  to  expend  any  resources  on 
that  task.  Learning  to  read  demonstrates  the  importance  of  teaching  individuals 
not  to  waste  resources  on  an  already  automatic  task.  If  word  encoding  is  fairly 
automatic  and  readers  continue  to  allocate  limited  control  processing  resources 
to  the  encoding  task,  they  reduce  resources  available  for  semantic 
comprehension.  Hence,  although  the  encoding  may  be  slightly  more  accurate,  the 
total  reading  performance  will  be  poorer.  LaBerge  and  Samuels  (1974)  report 
that  teachers  who  stress  accuracy  have  a  tendency  to  produce  poor  readers.  In 
development  of  a  complex  skill.  It  may  be  as  Important  In  some  situations  to 
stress  what  not  to  attend  to  as  well  as  what  to  attend  to.  We  have  found  that 
some  individuals  require  special  training  In  order  to  "let  go"  of  an  automatic 
process  (see  Schneider  &  Fisk,  In  press-a).  If  operators  have  a  tendency  to 
waste  resources  on  task  components  which  are  already  automatic,  they  will  not 
have  the  resources  available  for  performing  the  potentially  more  critical 
strategic  memory  components  of  the  task. 

Puai  task  parformance  measurfla  max  important  assessment  tools  Iol 
assessing  skill  competency.  We  often  find  little  difference  between  performance 
In  CM  and  VM  conditions  when  subjects  are  fully  attending  to  the  processing.  In 
many  conditions  the  difference  between  well  practiced  CM  performance  and  poorly 
practiced  VM  performance  is  quite  small  (e.g.,  only  differences  In  detection 
or  only  a  15  msec  slowing  in  reaction  time  when  subjects  must  search  for  only 
one  particular  stimulus  (see  Report  8002)).  LaBerge  (1973)  has  shown  that  when 
subjects  compare  well  learned  letter  stimuli  versus  novel  stimuli,  there  are  few 
differences  after  the  second  session  If  subjects  are  attending  to  the  comparison 
process.  However,  If  subjects  cannot  prepare  for  a  particular  novel  stimulus, 
differences  persist  for  greater  than  10  sessions. 

We  have  found  that  performance  on  a  task  which  Is  fully  attended  reaches 
asymptote  long  before  performance  on  that  task  when  the  condition  Is  treated  as 
a  secondary  task.  When  subjects  were  attending  to  a  CM  digit  detection  task  we 
found  accuracy  seemed  to  have  asymptoted  after  about  the  second  session  (see 
filled  triangles.  Figure  2).  However,  when  the  digit  detection  task  was  treated 
as  a  secondary  task  (open  triangles.  Figure  2)  performance  continued  to  Improve 
for  eight  sessions. 


Insert  Figure  2  about  here 


In  many  applied  situations  It  Is  Important  to  assess  competency  level  when 
the  operator  is  not  fully  concentrating  on  the  task.  For  example,  one  cannot 
consider  a  pilot  a  safe  pilot  when  he  can  only  land  his  aircraft  on  an  aircraft 
carrier  when  fully  attending  to  the  task.  If  something  unexpected  happens  near 
a  critical  maneuver  (e.g.,  a  warning  light  comes  on),  a  reduction  In  resources 
available  to  the  landing  task  may  result  In  failure  to  perform  the  landing 
properly.  By  training  operators  to  the  point  where  they  can  perform  the  task 
with  perhaps  half  of  the  available  resources,  there  would  be  a  substantially 
greater  margin  for  error  In  the  performance  of  critical  maneuvers.  The  Inflight 
refueling  training  task  (see  below)  illustrates  such  assessment  measures. 
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Motivational  Factors 

Our  experience  of  training  10,000  hours  of  automatic  process  development 
has  convinced  us  that  mot I  vat I on  la,  often  more  Important  than  many  other 
inanJftUlflt.lQna  la  Itia  development  asu  automatic  processes.  Motivation  Is  much 
more  Important  In  the  development  of  automatic  processes  than  It  Is  In  the 
development  of  declarative  knowledge.  The  first  problem  Is  that  automatic 
process  development  Is  very  slow  and  may  take  hundreds  of  trials.  The  second 
problem  Is  the  task  may  be  so  difficult  Initially  that  the  operators  will  doubt 
that  they  can  ever  perform  the  task  well  (e.g.,  most  people  who  try  to  learn  to 
play  a  musical  Instrument  quit  before  learning  to  play  well).  Third,  because  so 
much  practice  may  be  needed,  practicing  may  become  very  boring.  This  Is 
particularly  a  problem  since  very  early  In  practice  performance  may  be  accurate, 
but  not  automatic  (see  above  discussion  of  dual  task  performance  assessment). 
Fourth,  sometimes  operators  get  Into  a  passive  practice  mode  where  they  continue 
to  practice  but  do  not  Improve  In  performance.  We  have  had  subjects  plateau  and 
not  Improve  performance  even  after  10  hours  of  practice  In  a  simple  perceptual 
letter  detection  task. 

We  have  learned  to  motivate  our  subjects  by  a  variety  of  methods.  The 
experlmenter/subject  Interaction  Is  often  very  Important.  We  must  train  our 
experimenters  to  motivate  subjects  by  providing  encouraging  feedback  and  working 
with  the  subjects.  The  Importance  of  this  Is  Illustrated  by  the  fact  that  data 
from  new  subject  runners  Is  often  much  more  noisy  than  that  of  more  experienced 
subject  runners.  Our  procedures  also  encourage  subjects  to  compete  with 
themselves  and  others.  Subjects  are  typically  given  feedback  In  terms  of  their 
performance  from  day  to  day  and  their  relative  performance  to  other  subjects  In 
the  task. 

Our  most  effective  method  of  maintaining  concentrated  performance  has  been 
to  make  tasks  Intrinsically  motivating  by  making  them  like  arcade  games.  By 
providing  simple  Interesting  active  feedback,  we  can  greatly  Improve  subject 
learning.  For  example,  in  a  simple  target  detection  task,  once  a  subject 
correctly  detects  a  target  It  appears  to  spin  off  the  screen.  Adding  sound 
effects  (explosions  on  detections)  can  make  subjects  want  to  participate  even 
after  of  thousands  of  trials  of  training. 

We  have  found  that  providing  accuracy  feedback  with  discrete  cutoffs 
substantially  Improves  subject  motivation.  We  provide  subjects  both  percent 
correct  ratings  and  a  rating  of  whether  they  are  "ace,  good,  average,  or  novice" 
performers.  These  discrete  rating  values  are  provided  such  that  the  subject  Is 
basically  always  near  one  of  the  breakpoints  between  one  category  or  the  other. 
As  In  academic  grading  scales  (I.e.,  A  -  F),  the  learner  seems  always  to  be  near 
a  salient  cutpoint  for  one  category  or  the  other.  This  seems  to  maintain 
motivation  much  more  than  does  a  simple  continuous  percent  feedback  measure. 

We  have  also  found  that  subjects  improve  substantial ly  faster  when  their 
Initial  training  leads  them  to  expect  substantial  improvement.  We  found  that 
when  subjects  received  massed  CM  training  before  later  CM  and  VM  training, 
performance  Improved  much  more  than  If  they  had  received  initial  VM  training 
(see  Working  Paper  00-2) .  We  speculate  that  this  Improvement  Is  due  to 
motivational  factors.  In  the  condition  where  subjects  first  experienced  the  CM 
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training,  they  did  see  substantial  Improvement  during  the  first  hour.  We  feel 
this  resulted  In  their  spending  more  effort  In  the  second  hour  to  learn  to  do 
the  task.  Subjects  who  Initially  experience  VM  training  perform  substantially 
worse  In  later  tasks.  These  effects  were  quite  rel lable  (g.  <  .002). 

lllft  devalQDmant  gl  automatic  ski  I  Is  might  hfi  JDQlIfi  flPOrQPr.lfl.tftl  Y  XlftWfid.  l£flD 
Ihfl  persoect I ve  gt  coaching  than  teaching.  In  order  to  properly  perform  the 
task  once,  the  learner  must  be  given  sufficient  knowledge  to  execute  the  task. 
However,  to  become  automatic,  hundreds  of  consistent  correct  executions  may  be 
necessary.  A  critical  role  of  the  Instructor  Is  to  provide  a  motivational 
environment  to  maintain  practice  long  enough  to  develop  automatic  behaviors. 

On  the  basis  of  our  training  experience,  we  recommend  that  training 
programs  should  explicitly  attempt  to  maximize  motivation  wherever  possible. 
Note:  the  need  for  motivation  Is  often  considered  a  truism  In  training  programs. 
Or  worse  yet,  the  need  for  motivation  Is  stated  as  a  fact  but  not  Implemented 
Into  the  training  program.  If  special  sound  effects  Improve  performance  and  do 
not  substantially  alter  the  performance  context,  they  should  be  built  Into  the 
training  devices.  Probably  the  most  cost  effective  component  In  our  laboratory 
Is  a  fifteen  dollar  electronic  sound  chip  which  provides  noises  that 
substantially  Improve  subject  motivation  (and  hence  performance)  over  the 
thousands  of  trials  that  we  must  train  them. 

What  Can  Become  Automatic 

Since  automatic  processes  are  fast  and  effortless  compared  with  control  led 
processes.  It  Is  Important  to  know  what  activities  can  become  automatic.  We 
define  automatic  processes  operationally  In  terms  of  those  situations  where 
there  Is  substantial  Improvement  In  CM  conditions  relative  to  VM  conditions,  and 
there  Is  a  lack  of  secondary  task  deficit  after  extended  training  (for  detailed 
discussion  of  operational  definitions,  see  Shiffrin,  Dumals,  and  Schneider, 
1981).  During  this  contract  period  we  have  carried  out  a  number  of  experiments 
to  assess  the  range  of  activities  which  would  satisfy  the  above  operational 
definitions  of  automatic  processes.  This  research  has  tried  to  determine  the 
generality  of  the  automatic  processing  concepts  to  a  variety  of  experimental 
paradigms. 

Automatic  processes  appear  to  develop  only  when  subjects  consistently 
process  Information.  However,  It  Is  difficult  to  operationally  define 
"consistent  processing  of  Information".  We  have  already  discussed  results 
showing  that  when  stimuli  have  a  varied  mapping  across  trials  subjects’ 
detection  performance  does  not  Improve  with  training  (Report  8005;  Schneider  & 
Fisk,  1982).  However,  processing  need  not  be  consistent  from  stimulus  to 
response.  We  have  trained  subjects  to  consistently  attend  to  stimulus  while  the 
responses  to  stimuli  were  varied  across  trials.  Results  show  (Report  8103)  that 
Inconsistent  responding  slowed  the  development  rate,  but  did  not  affect 
detection  performance  on  tests  In  which  the  Inconsistent  responding  was 
eliminated.  Hence,  we  feel  that  automatic  performance  Improvement  will  occur 
when  components  of  a  task  are  consistent  even  If  the  entire  task  Is  not 
consistent  (see  also  Schneider  &  Fisk,  In  press-a). 

Experiments  which  manipulated  context  (Report  8009)  suggest  that  subjects 
can  develop  context  sped f Ic  automatic  processes.  A  context  specific  automatic 


Summary  of  Results 


Page  11 


process  will  develop  when  subjects  make  a  consistent  response  to  a  given 
stimulus  in  a  given  context,  but  Inconsistent  responses  across  contexts.  An 
example  of  this  context  specific  consistency  Is  Illustrated  by  driving.  A 
driver  often  automatical ly  responds  to  red  traffic  signals  by  stopping.  This 
response  Is  viewed  as  automatic  because  It  general ly  does  not  reduce 
undifferentiated  resources  (e.g.,  resources  utilized  In  conversation).  However 
in  the  context  of  walking,  the  same  external  stimulus  of  a  red  traffic  light  may 
Initiate  a  completely  different  set  of  behaviors  In  crossing  an  Intersection. 
Responses  to  many  stimuli  are  consistent  within  a  given  context,  but 
Inconsistent  across  contexts.  The  evidence  suggestive  of  context  specific 
automatic  processes  (Report  8009)  Indicates  that  automatic  processing  concepts 
may  determine  performance  In  situations  where  responses  are  at  least  consistent 
within  a  given  context. 

The  presence  of  context  specific  automatic  processes  greatly  Increases  the 
difficulty  of  defining  'consistency'.  The  context  may  be  either  Internal  or 
external.  In  our  experiments  (Report  8009),  some  subjects- Initial ly  required  an 
external  stimulus  (X's  or  O's  on  the  screen)  to  develop  context  specific 
automatic  processes.  But  after  sufficient  practice  (several  hours),  subjects 
could  perform  either  task  without  the  use  of  an  explicit  external  context.  In 
my  own  case  of  working  with  different  computer  text-editors  on  the  same 
terminal,  I  find  I  must  maintain  actively  In  memory  which  editor  I  am  working 
with  In  order  to  keep  from  making  responses  appropriate  to  the  other  editor. 
When  there  are  no  external  context  cues,  processes  must  be  cued  on  the  basis  of 
Internal  context.  If  the  Internal  context  Is  not  maintained,  behaviors  will 
slip  Into  those  of  the  more  developed  automatic  processes  (see  Norman,  1981). 

To  review,  our  results  on  examining  automatic  processes  suggest  that: 
CQJISlstancy  1&  a.  nBCaSSary  COnAJtlail  iSiL  automatic  process  development:  however. 
consistency  need  saU.  lift  maintained  ifiC.  a.  component  process  la  a.  given  context. 

Cana latent  moloc  output  aequencaa  appear  ±o  Psoomfl  automatic  with  practice. 
We  trained  subjects  to  perform  sequences  of  eight  button  pushes.  We  found  that, 
when  the  sequence  of  buttons  was  varied  from  trial  to  trial,  the  rhythm  of 
pushes  was  basically  unaffected  by  training  (see  Schneider  &  Fisk,  In  press-b). 
There  were  always  pauses  and  errors  at  multiples  of  two  responses.  In  a 
consistent  mapping  condition,  subjects  were  required  to  push  the  same  sequence 
of  buttons  across  trials.  In  the  consistently  mapped  button  push  sequences,  the 
pauses  and  errors  between  responses  decreased  with  training.  If  there  was  a 
variably  mapped  segment  within  a  string  of  consistently  mapped  digits,  there  was 
always  a  pause  and  an  Increase  In  error  rate  at  the  point  at  which  the  variably 
mapped  segment  began. 

Sequential  motor  output  data  seem  very  similar  to  the  perceptual 
experimental  data.  The  CM  sequences  were  fast  (no  large  pauses),  required 
little  effort,  and  were  of  high  accuracy  compared  to  the  performance  In  the 
variably  mapped  sequence  conditions.  We  expect  that  motor  output  sequences  will 
show  results  very  analogous  to  the  past  perceptual  experiments  we  have  done.  We 
are  continuing  research  to  determine  whether  the  training  principles  derived 
from  perceptual  experiments  general Ize  to  sequential  motor  output  conditions. 

Results  from  visual  spati.al  temporal  pattern  detection  experiments  siifin 
substantial  Improvaiants  Jdlh  practice  Aog.  potential  ly  Itia  existence 
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automatic  temporal  pattern  detectors.  Experiments  (Report  7901,  8003)  required 
subjects  to  detect  a  sequence  of  three  discrete  movements  of  a  line  segment.  In 
the  Of  conditions,  subjects  always  responded  to  a  particular  sequence.  In  the 
VM  conditions,  a  sequence  which  was  a  target  on  one  trial  could  be  a  distractor 
on  the  others.  In  general  the  CM  sequences  were  better  Identified,  less 
affected  by  processing  load,  and  less  affected  by  temporal  characteristics  of 
the  pattern.  The  CM  sequence  however,  showed  no  advantage  over  the  VM  sequence 
when  both  patterns  were  spatially  rotated.  Results  are  not  as  clearly 
qualitatively  different  as  we  have  seen  In  the  past.  Processing  of  discrete 
sequential  Information  may  require  control  led  processes  to  maintain  the  state  of 
the  previous  stimulus. 

Searching  for  conJuncHons  of  color  and  shape  can  be  greatly  speeded  with 
training  and  may  become  automatic  even  If  the  features  are  not  consistent. 
Trelsman  (Trelsman  &  Gelade,  1980)  has  claimed  that  subjects  cannot  do 
conjunction  search  without  focal  attention.  In  particular,  Trelsman  (Trelsman  & 
Gelade,  1980)  claims  that  subjects  can.  In  parallel,  find  a  particular  shape 
feature  or  a  given  color  feature,  but  subjects  must  sequentially  search  the 
display  with  focal  attention  to  detect  a  given  conjunction  of  color  and  shape. 
In  a  search  experiment  (Report  8008)  we  found  that  the  positive  slope  of 
reaction  time,  as  a  function  of  the  number  of  characters  In  the  display, 
decreases  In  the  conjunction  search  condition  from  26  msec  per  Item  to  10  msec 
per  Item.  We  also  found  that  there  were  no  qualitative  differences  between 
shape  and  conjunction  conditions.  Our  subjects  could  learn  to  rapidly  detect 
texture  boundaries  of  conjunctions  of  features  (e.g.,  find  the  row  which  has 
green  X's  and  blue  T*s  on  one  side  and  blue  X's  and  green  T’s  on  the  other). 
Boundary  detection  for  conjunctions  dropped  from  greater  than  2  seconds  to  .76 
seconds  over  about  900  trials  of  practice. 

The  conjunction  of  features  search  conditions  show  neither  clearly 
automatic  or  control  led  type  search  performance.  The  CM  search  conditions 
showed  substantial  reductions  In  slope,  negative  transfer  effects,  and  smaller 
effects  of  load.  However,  In  al I  CM  conditions  the  reaction  time  was  a  linear 
function  of  the  number  of  comparisons,  the  slope  of  the  negative'  responses  was 
twice  that  of  the  positive  responses,  and  when  memory  load  was  Increased, 
reaction  times  did  Increase.  Certainly,  the  processing  of  these  stimuli  do  not 
show  the  parallel  type  of  processing  we  have  seen  In  the  past  In  automatic 
processing  paradigms.  We  speculatively  Interpret  the  present  results  as 
suggesting  that  outside  of  focal  attention,  visual  resolution  Is  reduced,  and 
automatic  processing  has  poorer  spatial  resolution.  Hence,  lllluslonary 
conjunctions  (where  features  In  close  spatial  proximity  cause  subjects  to  put 
them  together  In  Inappropriate  combinations)  are  more  likely  to  occur.  These 
llluslonary  conjunctions  will  frequently  attract  attention  resulting  In  subjects 
Inconsistently  attending  to  the  real  target.  This  Inconsistent  attending  will 
slow  or  Inhibit  development  of  automatic  processing.  We  are  continuing  research 
on  the  topic  of  automatically  detecting  conjunctions  of  features. 

The  apparent  difficulty  of  developing  automatic  processing  for  conjunction 
stimuli  may  have  Important  Implications  for  Instrument  panel  design.  The 
Inability  to  resolve  conjunction  stimuli  without  focusing  attention  on  the 
location  of  the  stimulus  (see  Trelsman  &  Gelade,  1980)  suggests  that 
Instrumentation  systems  should  not  allow  features  which  can  cause  llluslonary 
conjunctions  to  be  within  the  regions  of  Interaction  (e.g..  If  a  critical 
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warning  Indicator  shows  a  Red  X  which  Is  to  be  responded  to  automatically,  the 
features  of  red  and  X  should  not  be  al lowed  to  occur  within,  for  example,  two 
degrees  visual  angle).  We  are  continuing  research  on  the  spatial  resolution 
Issue. 

We  have  found  that  retinal  location  In  the  range  of  one  to  three  degrees 
has  little  effect  on  the  type  of  processing  (Report  8001).  Subjects 
participated  In  a  two  alternative  choice  reaction  time  task,  Posner  match  task, 
and  scanning  memory  set  size  one  and  three  task.  They  also  carried  out  a 
multiple  frame  memory  set  size  two  CM  and  VM  search  task.  The  main  effects  of 
experimental  paradigm  and  retinal  locus  were  significant,  but  the  Interactions 
were  not.  The  results  suggest  that  the  automatic  letter  encoding  stage  can  take 
the  form  of  a  discrete  stage  of  continuous  output  which  cascades  at  the  next 
stage  for  search  and  detection. 

Results  using  the  Incidental  learning  paradigm  (Report  8007)  suggest  that 
automatic  processes  ilQ  nfii  modify  memory  without  Hifi  ^21  control  processing. 
Hasher  and  Zacks  (1979)  have  suggested  that  encoding  of  word  frequency  and  word 
recency  Is  automatic.  Our  experiments  do  not  support  the  Hasher  and  Zacks 
position.  When  subjects  were  engaged  In  automatic  search  the  subjects'  recall 
and  recognition  performance  was  at  chance  for  the  distractors.  In  a  frequency 
Judgment  task,  subjects  were  presented  a  word  40  times  for  a  total  of  24  seconds 
while  carrying  out  a  secondary  task.  Subjects'  median  estimation  for  the 
frequency  of  occurence  of  this  word  which  was  presented  40  times  was  zero.  We 
found  no  evidence  that  frequency  encoding  Is  automatic.  We  Interpret  these 
results  as  Indicating  that  memory  modification  requires  control  processing. 

Automatic  processing  £aa  l2£t  devel-aofld  IsiL  MQCd  oDSl  Category  dfltsctjflil.  We 
have  carried  out  word  and  category  versions  of  probe  reaction  time  tasks  similar 
to  the  letter  search  experiments  we  have  done  previously  (Schneider  i  Shiffrin, 
1977).  The  experimental  procedure  presented  subjects  two  words  and  required 
them  to  push  a  button  If  one  of  the  words  was  one  of  either  four  categories  or 
four  words  which  were  held  In  memory.  In  the  varied  mapping  conditions  reaction 
time  was  a  linear  function  of  the  number  of  Items  In  memory.  The  slope  In  the 
word  search  condition  was  47  msec  per  Item,  In  a  category  condition  It  was  92 
msec  per  Item  for  positive  responses.  In  the  consistently  mapped  conditions 
there  was  no  effect  of  number  of  comparisons  (slope  of  2  msec).  In  another 
experiment  subjects  showed  that  they  could  carry  out  Joint  CM  category  search 
and  a  simultaneous  digit  task  without  any  deficit  In  either  task.  These  results 
suggest  that  subjects  can  develop  automatic  category  search  capabilities.  After 
subjects  consistently  attended  to  some  members  of  a  category,  any  member  from  a 
consistently  attended  category  can  attract  attention.  In  this  way  operators  can 
learn  to  attend  and  respond  to  classes  of  events  as  well  as  Individual  events. 
We  have  also  shown  that  If  you  attend  to  a  subset  of  elements  In  a  category, 
there  Is  a  very  high  degree  of  transfer  to  the  remainder  of  the  category. 

Can  automatic  processing  be  done  without  cost  of  nonspecific  resources? 

If  automatic  component  processes  can  be  performed  without  ceBsomlng 

a  limited  resource  pool,  then  there  Is  no  simple  Identifiable  resource  limit 
to  human  processing  capabilities.  A  major  defining  characteristic  of  automatic 
processing  Is  the  proposed  costless  nature  (see  Shiffrin,  Dumals,  and  Schneider, 
1981);  that  Is,  one  can  perform  an  automatic  process  with  no  decrement  In 


Summary  of  Results 


Page  14 


performance  of  a  concurrent  secondary  task.  The  task  of  reading  Illustrates  the 
value  of  having  an  automatic  encoding  process.  Reading  requires  the  encoding  of 
features,  letters,  words,  phrases,  and  basic  semantic  concepts.  We  suggest  that 
for  the  skll led  reader  al 1  of  these  stages  may  be  automatic  for  texts  the  reader 
frequently  reads,  hence  these  encoding  processes  should  not  reduce  resources 
available  for  semantic  Integration  of  the  material  being  read.  We  believe  the 
execution  of  each  of  these  automatic  component  processes  does  not  reduce  the 
readers*  resources  available  for  semantic  comprehension  (Schneider  and  Fisk,  In 
press-b).  But  this  Is  not  to  suggest  that  there  are  not  structural  Interference 
problems  between  automatic  processes.  For  example.  If  two  automatic  processes 
attempt  to  activate  simultaneous  responses  In  working  memory,  there  will  be 
structural  Interference.  Also,  If  stimuli  become  highly  confusable,  control 
processing  may  become  necessary  to  resolve  feature  confusion. 

Subjects  can  perform  an  autflBatlc  detection  seflrch  wbllfl  performing  a 
simultaneous  control  process  search  task  sithout  A  sansItlvJAy  deficit  ia  either 
task  (Report  8002) .  Subjects  performed  a  VM  search  task  looking  for  a 
particular  subset  of  letters  on  one  diagonal  of  a  display.  Simultaneously, 
subjects  also  performed  a  CM  detection  task  (looking  for  any  digit)  on  a  second 
diagonal  of  a  display.  There  was  no  trade  off  between  the  two  tasks  In  terms  of 
sensitivity  (see  Figure  2).  Subjects  could  perform  either  task  In  combination 
as  well  as  they  could  perform  the  tasks  singly.  However,  In  order  for  the 
subjects  to  perform  each  task  simultaneously,  subjects  had  to  be  strongly  biased 
to  maintain  performance  on  the  VM  task.  This  resulted  In  a  severe  criterion 
shift  In  the  CM  task. 

In  a  Joint  category  search  and  serial  digit  recall  task  (Report  8103),  we 
also  found  no  cost  of  combining  the  category  detection  task  with  the  digit 
recall  task.  In  these  experiments  subjects  had  to  encode  and  rehearse  eight 
digits  while  sixteen  words  were  simultaneously  presented  for  categorization.  A 
categorization  required  pushing  a  button  every  time  a  word  from  one  of  four 
categories  (I.e.,  body  parts,  animals,  furniture,  fruits)  was  presented.  If  the 
categorization  task  was  conslstently-mapped-detectlon,  the  addition  of  the 
primary  digit  recall  task  dropped  detection  performance  only  7t  which  was 
nonsignificant,  and  memory  recall  performance  was  unaffected. 

In  all  our  dual  task  experiments  we  typically  find  that  subjects  general ly 
require  time  (e.g..  ^  least  ImA  hours)  at  performing  taSl  IfilkA 
simultaneously  before  the  two  tasks  do  not  Interfere.  This  need  for  some  time 
sharing  experience  suggests  to  us  that  subjects  are  developing  some  sort  of 
enabling  condition  which  allows  multiple  automatic  processes  to  co-occur.  We 
believe  that  subjects  enable  automatic  processes  by  maintaining  particular  nodes 
In  short-term  memory.  Whenever  that  node  Is  active  In  short-term  memory  and  the 
particular  stimulus  appropriate  to  that  automatic  process  occurs,  the  process 
takes  place  with  no  additional  resource  cost.  However,  when  subjects  are 
required  to  perform  two  tasks  simultaneously,  both  enabling  nodes  must  be 
activated.  The  activation  of  two  versus  one  node  would  present  some  cost  to  the 
subject.  With  dual  task  timesharing  experience,  we  expect  the  operator  will  be 
able  to  develop  a  new  node  which  represents  an  activating  condition  for  both 
Individual  automatic  processes.  This  Is  similar  to  the  notion  of  chunking  In 
short-term  memory.  It  takes  about  as  much  short-term  memory  capacity  to  store  a 
letter,  a  word,  or  a  well  known  phrase  In  memory.  This  would  suggest  that  the 
Integration  time  for  combining  two  we  1 1 -developed  automatic  processes  should  be 
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relatively  Independent  of  the  complexity  of  the  processes  themselves. 

The  recent  results  suggest  that  at  least  some  automatic  processes  can  be 
performed  without  any  measurable  costs  of  resources.  However,  the  presence  of 
structural  competition  between  automatic  component  processes,  the  limitations  of 
activating  any  Information  In  short-term  memory,  and  the  frequent  use  of  control 
processing  for  strategic  decisions  and  maintenance  of  automatic  processing 
enabling  nodes  clearly  Imply  I Im Its  to  the  extent  to  which  automatic  processes 
can  be  combined  without  costs.  We  feel  that  productions  system  modeling 
techniques  (e.g..  Hunt,  1981)  provide  a  mechanism  for  Interpreting  how  automatic 
and  control  processes  Interact  to  maximize  human  performance. 

Reliability  of  Automatic  Processing  for  Applied  Settings 

In  general  we  have  found  that  automatic  processes  are  fairly  Insensitive  to 
reductions  In  effort  either  through  manipulations  of  vigilance,  secondary  task 
load,  or  drug  effects.  Since  m.^Vty  applied  settings  require  operator  performance 
under  a  variety  of  stresses,  it  is  Important  to  build  processing  capabilities 
which  are  reliable.  In  oui^  vigilance  experiments  (Report  8006;  Fisk  & 
Schneider,  1981),  we  fount  that  automatic  processing  detection  sensitivity 
performance  was  not  affected  b  -  time  on  task  during  a  50  minute  session. 
Performance  on  a  controlled  ptyr'^sss  (VM)  search  task  was  significantly  affected 
by  time  on  task.  In  terma  of  hit  rate  the  automatic  processing  hit  rate  dropped 
about  \5%  during  the  session,  whereas  the  control  process  hit  rate  dropped  about 
35$. 


In  dual  task  experiments,  we  have  found  that  when  resources  are  removed 
from  automatic  process  tasks,  there  are  no  decrements  In  performance  (Report 
8002,  8103).  However,  If  resources  are  removed  from  a  control  processing  task, 
performance  often  drops  to  chance  detection  level.  Hence  In  situations  where 
there  might  be  multiple  task  requirements  or  where  operators'  attention  may 
drift.  It  may  be  particularly  Important  to  develop  automatic  processes. 

We  have  carried  out  some  pilot  studies  examining  the  effects  of  alcohol  on 
automatic  and  control  processing  (these  were  not  supported  by  ONR  funds).  In 
these  studies  we  have  found  little  performance  decrement  In  automatic  processing 
conditions  and  substantial  (32$  decrement  In  Inconsistent  responding  condition, 
20$  decrement  in  letter  detection  dual  task  letter  and  tone  detection)  reduction 
In  detection  rate  In  detection  tasks  which  require  substantial  control 
processing  resources. 

Theoretical  and  empirical  results  suggest  that  automatic  processes  will  be 
much  more  reliable  than  control  processes.  Hence  we  feel  special  attention  must 
be  given  toward  developing  automatic  component  skills  when  operators  will  be 
required  to  perform  tasks  of  long  time  durations,  tasks  requiring  complex 
time-sharing,  or  where  the  effects  of  drugs  or  fatigue  are  likely  to  reduce 
performance  levels. 

Individual  Differences  In  Automatic/Controlled  Processing 

Individual  differences  appear  In  the  rate  of  controlled  processing,  subject 
control  of  the  allocation  of  controlled  processing,  how  quickly  subjects  develop 
automatic  processing,  and  the  range  of  tasks  In  which  subjects  show  automatic 
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processing.  Since  automatic  processing  Is  much  faster  than  control  processing, 
most  of  the  between  subject  variability  found  In  consistent  search  tasks  Is 
determined  by  differences  In  the  development  rate  of  automatic  processes.  Some 
Individuals  develop  an  automatic  search  set  In  an  hour,  others  show  no 
development  after  six  hours.  Subjects  who  are  particularly  concerned  about 
doing  poorly  generally  have  greater  difficulty  In  performing  automatic 
processes.  We  have  found  that  about  a  quarter  of  our  subjects  have  a  great  deal 
of  difficulty  "letting  go"  of  an  automatic  process  (see  8002,  8201).  For 
example,  subjects  were  required  to  perform  a  category  word  search  and  digit  task 
either  as  single  task  or  as  a  combined  dual  task.  The  eight  subjects  had 
roughly  equivalent  single  task  performance  but  two  of  the  eight  subjects  could 
not  effectively  perform  the  dual  task.  Later  research  showed  that  these 
subjects  had  difficulty  In  Inhibiting  the  allocation  of  control  processing 
resources  to  the  automatic  process.  In  an  experiment  examining  context  effects 
about  half  the  subjects  did  not  appear  to  develop  context  specific  automatic 
processes  (Report  8009) . 

In  continuing  research  we  are  examining  a  population  of  high  school 
seniors  to  determine  the  range  of  Individual  differences.  We  are  assessing 
differences  In  ability  In  automatic/controlled  processing  and  relating  these 
differences  to  standard  psychometric  measures.  The  expectation  Is  that  computer 
task  measures  of  control  processing  performance  (I.e.,  VM  category  search)  will 
assess  capacity  and  willingness  to  perform  effortful  mental  processing  during 
ten  hours  of  training.  Computer  measures  of  automatic  processing  (I.e.,  CH 
category  search)  will  assess  automatic  processing  development  rate  and 
performance  asymptote.  We  are  examining  within  and  between  task  covariance  over 
ten  hours  of  training. 

In  addition,  our  high  school  students  are  tested  to  obtain  psychometric 
measures  of  "fluid"  and  "crystallized"  abilities  (Horne  &  Cattell,  1966).  We 
hypothesize  that  measures  of  fluid  ability  will  relate  to  controlled  processing 
and  measures  of  crystallized  ability  will  relate  to  automatic  processing.  We 
hope  to  ube  our  measures  to  better  predict  "learning  ability".  We  will  later 
use  our  measures  to  predict  learning  rate  and  performance  In  our  alr-trafflc 
control  task  (see  below). 
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Recommendations  for  Skill  Development  Training  Programs 

The  following  Is  a  set  of  rules  for  Improving  training  program  efficiency. 
These  rules  are  derived  from  both  our  experience  In  training  and  our  theoretical 
work.  At  this  point  we  have  trained  subjects  for  some  10,000  hours  In 
developing  perceptual  skills.  From  the  various  experiments  (see  above),  we  have 
found  certain  techniques  considerably  speed  the  rate  of  learning.  In  addition, 
our  theoretical  work  specifies  how  component  skills  can  become  automatic  In  the 
process  of  developing  complex  performance  capabilities.  In  the  next  section  we 
will  illustrate  how  these  rules  might  be  applied  In  an  alr-traffic  control  task. 

Rule  1.  Pxflseol  iQformatlQn  la  promote  consistent  processing  Itlfi 
operator.  Generally  there  are  many  ways  to  display  Information  to  an  operator. 
The  emphasis  here  Is  that  the  displayed  Information  should  allow  the  operator  to 
consistently  deal  with  that  Information.  For  example.  In  the  alr-traffic  control 
task,  when  two  aircraft  are  brought  together  for  Inflight  refueling  there  are 
typically  about  one  hundred  easily  distinguishable  solutions  which  will  bring 
the  two  aircraft  together.  If  training  Is  done  at  the  level  of  Individual 
solutions,  the  problem  can  have  one  hundred  equally  valid  outcomes.  If 
different  solutions  are  presented  on  different  trials,  our  work  would  suggest 
that  the  operator  would  not  learn  how  to  consistently  deal  with  the  situation. 
In  order  to  consistently  deal  with  the  situation,  the  operator  must  be  presented 
the  space  of  possible  solutions  (see  below).  By  experiencing  the  problem  at  the 
level  of  solution  spaces  the  operator  learns  to  deal  with  the  problem 
consistently.  We  are  carrying  out  research  In  training  operators  to  perform 
second  order  tracking.  In  this  situation  we  project  the  control  dynamics  of  the 
system  both  forward  and  backward  In  time  because  only  when  the  operator  sees  the 
complete  control  function  Is  It  always  consistent  (see  Eberts  &  Schneider, 
1980). 

Rule  2.  Design  tasks  to  allow  many  trials  of  critical  skills.  Our  work 
would  suggest  that  skill  development  Is  a  function  of  the  number  of  correct 
executions  of  the  component  skill.  In  the  alr-traffic  control  task  the  normal 
Intercept  for  Inflight  refueling  would  take  approximately  20  minutes  to  execute. 
Hence  one  would  expect  to  have  approximately  24  trials  In  an  eight  hour  day.  If 
we  speed  up  the  task  to  ten  seconds  per  trial,  one  could  get  2880  trials  per  day 
of  training.  If  learning  Is  primarily  a  function  of  the  number  of  correct 
executions  of  the  process  (Schneider  &  Fisk,  8004),  then  training  In  the 
speeded-up  fashion  could  speed  up  the  learning  process  120  times. 

Rule  3.  During  training  do  nut  overload  temporary  mamory  AlUl  minimize 
memory  decay .  Human  short  term  memory  Is  limited  to  about  five  Items;  human 
auditory  memory  decays  between  one  and  three  seconds;  and  visual  images  decay  In 
the  range  of  .1  to  1  second.  As  displays  require  the  operator  to  maintain 
Information  over  periods  greater  than  this,  the  operator's  ability  to  Integrate 
the  Information  will  decline.  In  the  alr-traffic  control  task,  a  360  degree 
turn  typically  requires  about  4  minutes,  but  the  visual  display  system  decays  In 
about  4f  of  that  time.  Hence  an  operator  observing  such  turns  will  very  slowly 
learn  the  size  of  a  standard  turn.  If  the  turn  process  Is  speeded  up  about  240 
times,  or  the  total  trajectory  Is  displayed  on  the  scope  screen,  the  operator 
will  not  have  as  much  difficulty  integrating  the  visual  stimulus  and  Is  more 
likely  to  learn  the  perceptual  characteristics  of  the  task. 
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Rule  4.  Vary  aspects  ^  the  task  which  will  vary  In  the  operational 
situation.  In  the  alr-trafflc  control  task,  planes  can  come  In  at  different 
angles.  If  the  operator  Is  always  trained  such  that  one  plane  is  traveling  at  a 
zero  degree  heading,  the  operator  Is  unlikely  to  realize  the  similarity  of 
different  Intercepts  as  the  angles  of  the  two  planes  are  rotated.  For  example, 
the  possible  Intercepts  for  two  planes  coming  at  the  headings  of  0  and  90 
degrees  are  the  same  as  two  planes  coming  at  the  angles  of  200  and  110  degrees. 
Hence,  If  the  actual  headings  are  changed  and  operators  are  Instructed  to  attend 
to  the  actual  Intercept  angle,  operators  have  a  better  chance  of  learning  a 
strategy  of  accomplishing  Intercepts  for  given  angles  independent  of  the  Initial 
rotation  of  the  Incoming  aircraft. 

Rules.  Maintain  active  participation  minimizing  passive  observation  al 
the  task.  A  critical  distinction  between  learning  declarative  knowledge  and 
skill  knowledge  Is  that  training  for  declarative  knowledge  generally  requires 
presenting  new  Information  with  every  Informational  display.  In  the  standard 
undergraduate  survey  course,  there  Is  very  little  direct  repetition  of  the 
material  presented  In  the  course.  In  contrast,  learning  to  detect  even  simple 
letter  stimuli  may  require  hundreds  of  trials  of  training.  If  the  operator  Is 
passively  presented  displays  which  he  or  she  Is  to  learn,  the  marginal  return 
for  presenting  the  display  passively  after  the  tenth  time  Is  probably  very  close 
to  zero.  In  order  to  actively  deal  with  the  stimulus  the  operator  should  be 
required  to  categorize  the  stimulus,  compare  the  stimulus,  or  transform  and 
compare  the  stimulus.  The  operator  should  be  frequently  tested  (e.g.,  every 
trial)  to  verify  active  participation  In  the  task. 

Rule  6.  Maintain  high  motivation  throughout  the  task.  In  developing  a 
skill  It  Is  Important  to  note  that  the  learning  rate  can  be  very  slow  and 
exhibit  apparent  asymptotes.  If  operators  lose  motivation  either  because  they 
feel  they  cannot  successfully  do  the  task,  or  the  task  is  Just  too  boring, 
practice  will  either  cease  or  be  much  more  passive.  Our  research  has  shown  that 
even  after  subjects  are  at  asymptote  when  they  attend  to  the  task,  substantial 
additional  practice  may  be  necessary  to  perform  the  task  while  under  high 
workload.  However,  when  one  Is  at  an  apparent  asymptote,  there  Is  little 
Intrinsic  motivation  to  attempt  to  do  the  task  any  better.  For  the  above 
reasons.  It  may  be  necessary  to  provide  artificial  motivation  to  continue 
practice  at  the  task.  Methods  which  would  be  likely  to  maintain  motivation 
might  include:  engaging  feedback  (e.g.,  in  the  alr-trafflc  control  task,  missed 
Intercepts  result  In  crashing  aircraft),  performance  feedback  that  provides 
salient  outpoints  (e.g.,  dividing  operators  into  five  skill  classes  based  on 
some  continuous  measure  of  performance),  and  encouraging  competition  among 
operators  (e.g..  It  Is  often  beneficial  to  divide  the  group  Into  teams  to  add 
team  competition  motivating  effects). 

Rule  7.  Present  Information  In  total  context  If  possible  as  long  such 
presentation  jJoas.  nfi±  resu 1 t  la  processing  overload.  When  presenting  one 
component  task  to  the  operator.  It  Is  often  possible  to  present  other  components 
of  the  task  so  the  operator  experiences  the  to-be-trained  component  within  the 
context  of  other  components. 

Rules.  Train  under  mild  spaed  stress.  Mild  speed  stress  encourages  the 
operators  to  develop  more  efficient  automatic  processes.  In  addition,  faster 
operator  processing  results  In  more  training  trials  per  session. 
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Rule  9.  Train  strategies  which  minimize  operator  workload.  in  many 
skilled  tasks  there  are  a  number  of  strategies  that  may  result  In  equal 
performance  accuracy  but  lead  to  differential  operator  workload.  For  example. 
In  driving  an  automobile,  one  can  either  drive  by  lining  up  the  hood  ornament  on 
the  right  road  stripe,  or  anticipate  the  curves  and  turn  the  wheel  appropriately 
for  the  sharpness  of  the  curve.  Both  may  result  In  approximately  equal 
performance.  However,  the  former  strategy  may  require  operator  Judgment  every 
half  a  second,  while  the  latter  strategy  may  require  an  operator  judgment  only 
every  ten  seconds.  Hence,  the  latter  strategy  requires  considerably  less 
operator  workload.  It  Is  Important  In  training  a  complex  skill  to  train 
strategies  that  minimize  operator  workload.  In  fact.  It  may  be  necessary  to 
prohibit  operators  from  using  easy  to  learn  but  high  workload  strategies  for 
performing  a  task. 

Rule  10.  iisfi.  tfiStS  under  high,  secondary  task  work  I  oad  i;Q  assess  competence 
and.  iaciiitflte  automatic  process  development.  We  have  often  found  that 
operators  will  show  an  early  asymptote  In  performance  when  they  are  attending  to 
the  task.  For  example,  we  found  that  subjects*  performance  on  a  task  reached 
asymptote  after  the  second  hour  when  they  were  fully  attending  the  task,  but 
continued  to  Improve  for  six  hours  when  the  task  was  a  secondary  task.  Testing 
In  high  workload  environments  may  also  encourage  the  operators  to  develop  low 
workload  strategies. 

Rulell.  Provide  consistent  stimuli  for  categories  of  events  which  have 
moaning  lO  the  operator .  The  features  of  the  symbols  should  consistently 
Identify  the  operational  characteristics  of  that  symbol  to  the  operator.  For 
example.  In  alr-traffic  control.  It  would  be  useful  to  Identify  each  class  of 
aircraft  (e.g.,  Jumbo  Jet,  small  Jet,  private  aircraft)  with  symbols  that 
Identify  the  type  of  aircraft.  Such  Identification  would  minimize  the  need  for 
the  operator  to  maintain  performance  Information  about  the  aircraft  In 
short-term  memory.  Reducing  short-term  memory  load  will  reduce  the  chances  for 
error. 
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Flg«r«  3.  Air  traffic  control  for  rondotvena  to  anablo  Infllglit 
refuallng.  Tha  llnaa  fro«  tha  smII  planaa  rapraaant  tha  Initial  poaltle 
and  haadlaga  of  tha  two  aircraft.  Tha  Intarcapt  anglo  la  30  . 
operator  auit  0p#cify  th#  direct  Ion  of  turn  o®d  tho  otart  of  torn  of  ooch 
aircraft  plua  tha  final  rollout  haadlng.  Tha  clrcla  rapraaants  tha  turn 
radlua  of  tha  aircraft. 
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Application  of  Automatic/Controlled  Processing  Concepts  to 
Inflight  Refueling  Alr-Trafflc  Control 

The  following  description  serves  two  purposes.  First  It  provides  a 
concrete  Interpretation  of  how  automatic  and  controlled  processes  might  Interact 
In  a  complex  skill.  Second,  It  Illustrates  the  application  of  the  training 
principles  described  above  to  training  the  task  of  Inflight  refueling.  Note 
that  this  Is  not  yet  a  specification  of  how  to  efficiently  train  automatic  and 
controlled  processing  skills.  These  statements  are  examples  of  what  we  feel 
should  be  done.  In  the  coming  contract  period  we  will  be  examining  how  much  the 
learning  efficiency  can  be  Improved  by  applying  these  principles. 

Specification  of  Inflight  Refueling  Alr-Traffic  Control  Task 

The  Job  of  the  alr-traffic  controller.  In  Inflight  refueling.  Is  to  give 
turn  commands  and  speed  commands  to  two  pilots  such  that  two  aircraft  will 
rendezvous  heading  In  a  given  direction.  Figure  3  Illustrates  a  basic 
rendezvous  for  Inflight  refueling.  The  controller  must  specify:  the  turn 
direction  for  each  aircraft  (starboard  or  port),  the  time  that  each  aircraft 
begins  Its  turn,  and  the  final  rollout  heading  of  the  two  aircraft.  We  will 
limit  our  discussions  to  a  slightly  more  difficult  version  of  the  control  task 
in  which  the  operator  Is  allowed  only  one  turn  per  aircraft  and  the  two  aircraft 
must  fly  at  a  fixed  speed.  We  simplify  the  task  slightly  by  training  operators 
to  get  the  two  aircraft  to  rendezvous  at  the  same  point  In  time  as  opposed  to 
rendezvousing  one  aircraft  two  nautical  miles  behind  the  other  as  In  the  real 
task  (all  of  the  following  discussions  are  essentially  equivalent  If  we  consider 
rendezvous  with  the  delay).  Most  of  the  principles  discussed  In  the  following 
presentation  relate  to  other  close  alr-traffic  control  tasks  (landings, 
takeoffs.  Intercepts). 


Insert  Figure  3  about  here 


Learning  to  perform  a  particular  standard  solution  for  Inflight  rendezvous 
requires  a  modest  amount  of  training,  perhaps  two  weeks.  A  standard  'iO'jtlon 
might  be  a  tanker  on  turn  rendezvous  where  the  two  aircraft  approach  e^t  a  180 
degree  angle  at  a  fixed  displacement. 

Unfortunately,  In  operational  environments  "the  standard  solution"  Is  often 
not  available.  For  example,  bad  weather,  other  air  traffic,  aircraft  being  low 
on  fuel,  and  the  presence  of  damaged  aircraft  all  may  make  the  "standard 
solution"  unavailable.  Major  William  Derrick  (USAF)  estimated  that  he  performed 
approximately  two  "standard  tanker  on  turn"  rendezvous  In  a  year  of  active  duty 
In  Thailand.  Most  of  the  other  rendezvous  could  not  be  performed  as  the 
"standard"  rendezvous  because  of  various  operational  constraints. 

In  operational  environments.  It  Is  Important  for  the  operator  to  have 
available  many  possible  solutions  for  a  given  problem  Instead  of  a  single 
"standard"  solution.  With  multiple  solutions  available,  the  operator  can  choose 
the  particular  solution  which  Is  best  for  the  given  operational  constraints. 
However,  training  the  operator  to  visualize  all  the  possible  solutions  can  be 
quite  difficult.  For  a  simple  30  degree  Intercept  as  Illustrated  In  Figure  3, 
there  are  actually  100  possible  solutions  to  the  problem  (assuming  the  aircraft 
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rollout  In  10  degree  Intervals).  CTo  Illustrate  the  difficulty  of  the  task,  the 
reader  should  examine  Figure  3  and  find  the  routes  where  the  two  aircraft  would 
first  meet  If  they  rendezvous  at  a  130  degree  heading  (southeast) .3  There  are 
three  combinations  of  turns  which  will  result  In  the  two  aircraft  heeding  out  at 
the  specified  angle.  Only  one  of  these  three  solutions  Is  easy  to  find.  It  Is 
difficult  to  Intuitively  have  a  feel  for  where  possible  solutions  might  be. 

The  solution  space  of  the  Intercept  Is  very  complex.  It  Is  doubtful  that 
any  operator  could  learn  to  deal  with  the  full  solution  space  In  traditional 
training  programs.  Figure  4  Illustrates  all  the  possible  solutions  to  the 
problem  specified  In  Figure  3.  There  are  100  possible  solutions  (at  10  degree 
headings)  to  the  problem  for  a  simple  30  degree  Intercept.  Figure  5  shows  the 
solution  space  when  the  two  aircraft  will  not  cross  each  other's  path  at  the 
same  point  In  time.  Note  the  substantial  difference  in  position  of  the 
rendezvous  (Figure  4  versus  5)  given  a  rather  small  change  In  the  displacement 
of  the  lower  aircraft.  The  substantial  transformation  of  the  solution  space 
caused  by  small  modifications  of  the  intercept  Illustrates  the  difficulty  of  the 
control ler's  task. 

Training  the  operator  to  manipulate  the  full  solution  space  (e.g..  Figure 
4)  cannot  practically  be  accomplished  If  the  training  Is  done  in  real  time.  If 
an  operator  wore  to  run  a  I  I  the  Intercepts  represented  In  Figures  4  4  5  In  real 
time  (about  20  minutes/ Intercept)  It  would  take  35  hours  (for  100  Intercepts). 
Since  there  Is  no  clear  relationship  between  all  the  solutions.  It  would  be 
unlikely  for  an  operation  to  Integrate  over  the  35  hours  of  training  well  enough 
to  be  able  to  draw  out  the  total  solution  spaces  as  represented  In  Figures  4  4 
5. 


Insert  Figures  445  about  here 


The  proposed  training  program  wl 1.  train  operators  to  perceive  and 
manipulate  solution  spaces.  The  operator  will  be  trained  to  visualize 
prototypical  spaces  as  Illustrated  In  Figure  4.  The  operator  will  then  learn  to 
manipulate  the  prototype  to  the  proper  angle  and  displacement  (see  below)  of  the 
two  aircraft. 

The  goal  of  the  fol lowing  training  program  Is  to  teach  operators  to 
perceive  all  the  possible  solutions  to  the  Intercept  problem.  We  want  to  train 
operators  so  they  see  not  a  single  solution,  but  rather  a  set  or  space  of  all 
possible  solutions  of  the  problem.  if  the  operator  can  see  this  "space"  of 
solutions,  the  operator  can  quickly  choose  among  the  solutions  within  the  space 
to  get  the  solution  that  best  fits  the  appropriate  operational  conditions. 

Assumed  Automatic/Control  led  Components  of  ATC  Task 

Figure  6  provides  a  flow  chart  with  the  basic  stages  of  the  alr-traffic 
control  task  for  Inflight  refueling.  We  break  down  the  task  Into  four  basic 
stages.  The  first  stage  Involves  Identifying  the  constraints  of  the  problem. 
The  operator  must  Identify  the  Intercept  angle  of  the  two  aircraft.  Identify  the 
relative  distance  of  the  two  aircraft  when  their  paths  cross,  and  Identify  any 
other  constraints  of  the  solution  (e.g.,  what  direction  the  two  aircraft  should 
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Plg«r«  4.  Solution  apoco  for  a  30  dogroa  intorcopt  lAora  tha  tuo 
aircraft  ara  on  a  eollialon  couraa.  Inch  arrow  rapraaanta  a  poaaibla 
randaawona  poiat  baginning  at  tha  atart  of  tha  arrow.  Thla  flgura 
rapraaonta  tha  aolwtlon  apaca  aaauailng  both  aircraft  ara  trawallng  at  400 
kaota  and  hava  a  turn  radlaa  of  4.2  nautical  ullaa.  Thla  would  bo  typical 
of  a  KC-13S. 
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Figar*  5.  Solatloa  space  for  a  30  gagraa  iatarcapt  with  tka  tva  aircraft 
oa  a  aoa*celllslea  caursa.  Hila  iatarcapt  is  tha  saM  as  Flgara  4  aacapt  tka 
loaar  aircraft  starts  froa  a  pasitiea  9  aaatieal  ailas  fartkar  soatk.  geta 
tka  larga  diffaraaeas  katwaaa  Piguraa  4  aad  5  rasaltiag  froa  a  saall  ckaaga 
ia  posit iaa  of  tka  two  aircraft. 


Table  1 

Rendezvous  Solution  Equations 
(assume  plane  2  turns  onto  path  of  plane 

T2(1)-(0UTANG  -  ANGLEd)  »  R)/(DIR(1)  »  V) 

T2(2)»(0UTANG  -  ANGLE(2)  »  R)/(DIR(2)  *  V) 

T3(2)=0  I  strategy  assumption 

T3(1)=  {[V  »  SIN(ANGLE(2))  *  (T2(1)  -  T2(2))  + 

CX(2)  -  SIN(ANGLE(2))  »  0IR(2)  * 

R  »  (1  -  (X)S(T2(2)  *  V/R))  + 

SIN(ANGLE(2))  »  R  »  SIN(T2(2)  *  V/R)D  - 
CXd)  -  SIN(ANGLEd))  »  DIRd)  * 

R  »  (1  -  00S{T2d)  »  V/R))  + 

SIN(ANGLEd))  «  R  •  SIN(T2d)  «  V/R)33  “ 

CV  »  00S{ANGLE(2))  *  (T2d)  -  T2(2))  + 

CY(2)  -  SIN(ANGLE(2))  *  DIR(2)  « 

R  *  (1  -  00S(T2(2)  •  V/R))  + 

C0S(ANGLE(2))  »  R  *  SIN(T2(2)  »  V/R)3  - 
[Yd)  -  SIN(ANGLEd))  *  DIR  d)  * 

R  »  (1  -  (X)S(T2d)  »  V/R))  + 

COS(ANGLEd))  »  R  »  SIN(T2d)  *  V/R)]3  » 

LV  »  SINfANGLEd))  -  V  »  SIN(ANGI.E(2))  - 

V  *  OOS(ANGLEd))  -  V  »  (X)S(ANGLE(2) )33  / 
iCV  »  SINfANGLEd)  +  DIRd)  ♦  T2d)  *  V/R)  - 

V  »  SIN(ANGLE(2))]  - 

CV  »  (X)S(ANGLEd)  +  DIRd)  »  T2d)  *  V/R)  - 

V  «  00S(ANGLE(2))]  » 

CV  »  SlN(ANGLEd))  -  V  »  S INC ANGLE(2) )  - 

V  *  COS(ANGLEd))  -  V  *  C0S(ANGLE(2)  )D3 

Tld)=tCV  »  SIN(ANGLE(2))  »  (12(1)  -  T2(2)):  + 

CX(2)  -  SIN(ANGLE(2))  »  DIR(2)  » 

R  «  d  -  (X)S{T2(2)  «  V/R))  + 

SIN(ANGLE(2))  •  R  »  SIN(T2(2)  *  V/R)J  - 
CXd)  -  SIN(ANGLEd))  »  DIRd)  * 

R  »  (1  -  00S(T2d)  »  V/R))  + 

SIN(ANGLEd))  »  R  *  SIN(T2d)  *  V/R)]  - 
CV  »  SINfANGLEd)  +  DIRd)  *  T2d)  »  V/R)  - 

V  »  00S(ANGLE(2))]  » 

T3d)3/ 

[V  »  SIN(ANGLEd))  -  V  »  00S{ANGLE(2) )] 

T1(2)*T1d)  +  T2d)  +  T3d)  -  T2(2) 

Where  V  =  velocity 

R  *  turn  radius 

I  *  aircraft  Index  1  or  2 

ANGLEd)  *  Initial  heading  of  aircraft 

Xd)  *  Initial  X  position  of  aircraft 

Yd)  »  initial  Y  position  of  aircraft 

OUTANG  “  output  angle  of  potential  rendezvous 

DIR(l)  *  direction  of  turn  -1  port,  +1  starboard 

T1 d )  ■  time  before  turn  begins 

T2{  I )  ■  time  In  turn 

T3d)  *  time  after  turn  until  rendezvous 


Table  2  Strategies 


Strategy 

Plane  1 

Plane  2 

Plane  to  Intercept 

1 

Port 

Starboard 

1 

2 

Starboard 

Port 

1 

3 

Port 

Port 

1 

4 

Starboard 

Starboard 

1 

5 

Port 

Starboard 

2 

6 

Starboard 

Port 

2 

7 

Port 

Port 

2 

8 

Starboard 

Starboard 

2 

Plane  to  Intercept  Indicates  which  plane  will  rollout  of  the  turn  last 
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be  heading  at  the  rendezvous).  Identification  of  the  Intercept  angle  of  the  two 
aircraft  and  the  temporal  displacement  should  become  automatic  with  practice. 
However,  maintaining  this  Information  would  require  controlled  processing 
resources. 

The  first  component  task  (step  1)  Includes  automatic  Identification  of 
Intercept  angle  and  temporal  displacement,  and  the  controlled  process 
maintenance  of  that  Information  plus  any  constraints  on  the  problem.  The  second 
task  component  Is  Identifying  acceptable  solutions.  This  Is  a  complex  task. 
Identifying  any  single  solution  Is  quite  difficult.  Table  1  shows  the 
mathematical  equations  that  must  be  solved  to  determine  whether  there  Is  an 
acceptable  solution  for  any  given  rollout  heading  given  a  specific  strategy.  In 
order  to  examine  all  possible  solutions,  the  operator  would  have  to  solve  that 
series  of  equations  288  times.  This  entails  extensive  calculating.  In  order 
for  a  modestly  high  speed  micro-computer  (LSI  11/23)  to  solve  these  equations  It 
takes  approximately  20  seconds.  A  human  operator  cannot  solve  these  equations 
In  real  time.  However,  we  believe  the  operator  can  solve  these  problems  by 
visualizing  potential  solution  spaces.  There  are  eight  potential  strategies  for 
solving  our  alr-traffic  control  task.  Table  2  lists  the  potential  strategies. 
We  assume  that  the  operator  visualizes  a  set  of  solutions  for  each  strategy 
(Step  2A,  see  below).  This  visualization  Includes  the  automatic  Identification 
of  the  solution  space  for  the  standard  Intercept  (e.g.,  90  degrees).  This 
solution  Is  then  transformed  through  controlled  processing  to  the  needs  of  the 
current  Intercept  angle  and  the  temporal  displacement  (Step  '’B) .  At  this  point 
we  assume  the  operator  has  a  mental  Image  for  all  of  the  solutions  for  that 
strategy  given  the  specifics  of  the  problem.  We  then  assume  that  the  operator 
Identifies  any  solutions  which  are  acceptable  given  current  operational 
constraints  (e.g.,  the  requirement  of  a  specific  rollout  heading)  (Step  20. 
The  operator  then  assesses  whether  the  current  solution  Is  better  than  any  of 
the  solutions  of  previously  Identified  strategies  (Step  2D).  If  this  solution 
Is  the  best  solution  so  far,  the  operator  stores  this  solution  In  short  term 
memory  (see  Step  2E).  This  sequence  of  visualization  and  comparison  will 
continue  until  all  eight  strategies  have  been  examined. 


Insert  Figure  6  and  Tables  1  A  2  about  here 


The  third  component  task  Is  verifying  the  solution.  At  the  end  of  stage  2 
the  operator  has  a  particular  solution  that  appears  to  be  the  best  given  the 
current  operational  constraints.  Qln  essence,  the  operator  knows  the 
approximate  location  of  the  solution.!]  However,  In  order  to  properly  execute 
the  maneuver,  the  operator  may  need  to  more  accurately  locate  the  point  of 
rendezvous  and  the  beginning  of  the  turns  of  the  two  aircraft.  Once  the 
location  Is  accomplished  we  assume  that  the  operator  then  projects  backwards 
from  the  rendezvous  to  the  Initial  starting  points  of  the  two  aircraft.  We 
assume  that  the  estimation  of  the  total  distance  would  be  primarily  an  automatic 
Identification  of  the  length  of  each  of  the  components  of  the  turn  (Step  3A). 
The  distances  for  each  aircraft  would  be  added  as  a  controlled  process  (Step 
3B) .  Thereafter  the  two  distances  would  be  compared  to  see  If  they  were  within 
the  acceptable  tolerance  for  the  rendezvous  (Step  30.  If  the  lengths  were  not 
within  range,  the  operator  would  attempt  to  Iterate  In  the  region  around  the 
solution  to  determine  a  solution  that  does  fall  within  range  (Step  3D). 
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The  fourth  component  task  amounts  to  executing  the  solution.  We  assume 
that  once  the  operator  has  Identified  the  point  of  Intercept  and  the  most 
appropriate  solution  strategy,  he  can  automatically  visualize  (Step  4a)  the  path 
the  aircraft  will  take  from  Its  Initial  starting  point  to  the  point  of 
rendezvous.  From  this  visualization  we  assume  that  the  operator  can  read  off 
(Stop  4b)  the  point  of  the  start  of  the  turn,  the  direction  of  turn,  and  the 
final  rollout  heading  of  the  aircraft.  The  operator  can  then  communicate  this 
Information  to  the  pilot,  resulting  In  the  execution  of  that  rendezvous. 

Proposed  Alr-Traffic  Ojntrol  Training  Program 

The  following  description  Is  a  specification  of  a  training  program  that 
will  develop  automatic  component  skills  for  alr-trafflc  control  for  Inflight 
refueling.  The  purpose  of  this  training  program  Is  to  train  operators  to  deal 
with  solution  spaces  for  the  Intercept  problem  such  that  they  can  quickly  pick 
the  best  solution  within  the  given  operational  constraints.  This  specification 
Illustrates  how  the  application  of  the  above  rules  can  generate  a  novel  training 
program  to  develop  complex  skills.  It  also  provides  an  Illustration  of  how  a 
training  program  using  a  microprocessor  based  trainer  could  Incorporate  the 
first  ten  training  guidelines  presented  above.  The  training  times  specified  for 
each  stage  are,  at  this  point,  only  speculative.  We  will  be  carrying  out  this 
training  program  to  assess  the  actual  training  time  and  performance  criterion 
that  result  from  such  a  training  program. 

The  guiding  principle  of  this  program  Is  to  build  automatic  component 
skills  such  that  performance  Is  fast,  accurate,  and  resistive  to  stress. 
Developing  an  automatic  skill  level  requires  many  practice  trials  (e.g.,  1000) 

at  accurately  performing  the  task.  To  maximize  learning  rate  we  minimize  the 
problems  of  memory  decay  through  speeding  up  of  the  displays  and  by  doing  part 
task  training  such  that  we  do  not  overload  the  subject.  The  operator  Is 
presented  many  consistent,  mildly  speed  stressed  executions  of  the  problem.  The 
problem  Is  represented  In  such  a  way  that  the  operator  can  perceive  the 
consistency  from  one  problem  to  the  next  (see  Stage  6).  The  task  difficulty  Is 
Increased  adaptively  so  that  the  operator  can  maintain  accurate  performance 
throughout  most  of  the  training.  In  order  to  have  many  motivated  trials  of 
training,  the  task  presentation  Is  speeded  up,  feedback  Is  made  Interesting,  and 
performance  Is  graded  to  encourage  competition.  Operators  are  exposed  to  the 
total  context  of  the  final  task  performance  In  order  to  facilitate  Integration 
of  the  component  skills.  After  the  skills  have  become  fairly  automatic, 
performance  Is  tested  to  determine  the  reliability  of  the  component  skills  under 
high  secondary  task  stress. 

Stage  1  ~  Identifying  rol lout  heading.  The  goal  Of  this  stage  Is  to  train 
the  operator  to  quickly  and  accurately  Identify  the  heading  of  the  aircraft. 
The  operator  Is  presented  an  aircraft  with  a  pointer  Indicating  Its  direction  of 
flight  (see  Figure  7-1).  The  operator  must  specify  whether  the  heading  Is  at  a 
greater  or  lesser  degree  heading  than  specified.  The  actual  presented  angle  Is 
or  -  4,  6,  or  8  degrees.  Both  end  of  trial  and  end  of  block  feedback  Is 

presented.  The  rating  categories  are  set  so  that  the  operator  perceives  him  or 
herself  as  always  being  near  one  of  the  cutoff  points.  The  break  points  are  ace 
-  90-100J  correct,  expert  -  80-89J,  good  -  70-79%,  fair  -  60-69$,  and  poor  - 
less  than  59$  correct.  The  rating  category  feedback  Is  presented  throughout  all 
stages  of  the  training.  The  plane  moves  In  the  specified  direction  with 
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Interesting  sound  effects  representative  of  a  flying  aircraft.  On  an  error,  an 
airplane  Indicator  Is  presented  showing  the  true  heading  as  well  as  the  test 
heading  and  a  computer  voice  speaks  the  proper  heading.  In  addition,  subjects 
receive  computer  voice  prompts  after  a  run  of  errors  (e.g.,  "two  wrong  -  try 
harder")  or  corrects  (e.g.,  "excellent  -  ten  correct").  The  second  type  of 
feedback  Is  cumulative  accuracy  feedback  at  the  end  of  a  block  of  trials.  On 
the  basis  of  the  accuracy  data  the  standard  deviation  of  the  operator’s 
representation  of  the  angle  will  be  estimated  (by  assuming  the  angle 
distribution  Is  normally  distributed  and  fitting  the  accuracy  data).  When  the 
operator's  standard  deviation  of  the  Internal  representation  has  a  standard 
deviation  of  4  degrees  or  less,  he/she  wilt  move  on  to  the  next  stage.  A  single 
trial  will  require  about  3  seconds.  The  estimated  training  time  will  be  1,080 
trials  or  approximately  1  hour  of  training. 


Insert  Figure  7  about  here 


This  part  of  the  training  program  Illustrates  observation  of  training  rules 
two  through  seven.  The  task  allows  many  trials  of  performing  the  critical 
heading  component  skill  (Rule  2,  I.e.,  1080  trials  In  one  hour).  The  task  does 
not  overload  temporary  memory  and  minimizes  memory  decay  (Rule  3).  The  stimuli 
are  always  present  on  the  screen  as  the  operator  makes  his  heading  judgment. 
The  aspects  of  the  task  which  vary  In  the  operational  situation  are  varied 
during  the  training  program  (Rule  4).  Each  time  the  aircraft  Is  presented  on 
the  screen  It  Is  at  a  different  angle  and  different  location.  The  operator  Is 
required  to  be  an  active  observer  (Rule  5)  by  requiring  him  to  judge  the  heading 
on  each  trial.  Motivation  Is  maintained  (Rule  6)  by  providing  both  Interesting 
trial  performance  feedback  and  competition  Inducing  accuracy  feedback.  Finally, 
the  operator  Is  trained  under  mild  speed  stress  (Rule  7).  Rule  8  requires 
training  of  strategies  which  will  result  In  minimizing  operator  workload  In  the 
final  task.  In  training  the  heading  Identification  skill,  the  operators  will 
not  be  allowed  to  consult  heading  Indicators  around  the  face  of  the  scope.  By 
developing  an  automatic  component  heading  skill  which  does  not  require  reference 
to  an  external  Indicator,  this  component  task  will  show  less  work  load  In  the 
more  complex  performance  stages. 

ilaoft  Z  —  I  dent  I  fy  Ing  start  Qt  turn  whan  the  Indicated  head  I  ng  is.  the 
turn.  The  goal  of  this  stage  Is  to  get  the  operator  to  autcmatically  Identify 
the  start  of  the  turn  as  wel I  as  the  rol lout  heading  on  the  turn.  This  task  Is 
Illustrated  In  Figure  7-2.  The  operator  Is  given  the  Initial  and  final  vectors 
of  the  aircraft  and  the  direction  of  turn.  The  final  vector  of  the  o'rcraft  Is 
always  on  the  turn  of  the  aircraft.  A  dot  will  be  presented  along  the  starting 
trajectory  of  the  aircraft.  The  dot  will  be  either  slightly  before  or  beyond 
the  point  where  the  turn  should  begin  (e.g.,  +  or  -  three  nautical  miles).  The 
operator  will  push  a  button  Indicating  whether  the  specified  turn  location  Is 
too  late  or  too  early.  On  a  correct  response  the  start  of  the  turn  point  will 
be  Indicated  and  the  aircraft  will  fly  the  specified  pattern  at  about  200  times 
normal  speed  (typically  .5  seconds).  On  an  error  In  specifying  the  start  of 
turn,  the  correct  start  of  turn  will  be  Indicated  but  the  aircraft  will  not  fly 
the  pattern.  When  an  error  occurs  the  operator  will  hear  an  error  tone.  The 
performance  criterion  for  moving  to  the  next  stage  will  be  when  the  standard 
deviation  of  the  operator's  start  of  turn  Is  less  than  3  nautical  miles  with  2 
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seconds  or  less  mean  reaction  time.  The  estimated  training  time  Is  600  trials 
or  about  1  hour.  This  stage  Illustrates  Rules  2-8. 

Staae  1  —  IdanUixIoa  start  at  turn  when  heaiilDa.  vector  ott  turn.  Figure 
7-3  shows  this  task.  The  task  Is  basically  equivalent  to  that  of  Stage  2, 
except  now  the  final  vector  of  the  aircraft  is  not  on  the  turn  but  displayed  In 
a  position  It  would  be  after  It  has  rolled  out  of  the  turn.  An  additional 
component  will  be  added  to  the  performance  feedback.  On  correct  trials  the 
operator  will  hear  the  distance  In  miles  of  the  specified  trajectory.  The 
estimated  training  time  to  a  criterion  Is  1,000  trials  or  2  hours. 

Stage  ±  —  Line  length  estimation.  The  goal  of  this  stage  Is  to  train  the 
operator  to  properly  estimate  the  distances  that  an  aircraft  will  travel  between 
two  points  during  the  execution  of  a  turn.  Figure  7-4  Illustrates  the  task. 
The  distance  between  the  starting  and  ending  position  has  three  components. 
There  Is  a  straight  vector  from  the  Initial  position  of  the  aircraft  to  the 
start  of  turn.  There  Is  a  distance  during  the  turn.  And  there  Is  the  distance 
from  the  end  of  the  turn  to  the  final  position  of  the  aircraft.  The  operator 
will  be  presented  with  the  starting  point  of  the  aircraft  and  the  ending  point 
of  the  aircraft.  The  operator  must  estimate  the  total  distance  from  the  start 
until  the  end  of  the  turn.  A  response  will  be  considered  correct  when  the  total 
distance  Is  within  5f  of  the  actual  distance.  On  a  correct  trial  the  plane  will 
fly  the  specified  pattern  and  the  operator  will  be  given  the  total  distance 
verbally.  On  an  error,  the  operator  will  be  verbally  presented  the  three 
component  distances  with  each  component  highlighted.  The  operator  must 
correctly  add  the  three  distances  and  enter  the  result.  This  Illustrates  the 
observation  of  Rules  2-9.  The  estimated  training  time  Is  1,000  trials  or  2 
hours. 

Stage  1  —  Estlina.tlng  Intercept  angle  aasL  distance  displacement.  The 
possible  set  of  solutions  for  any  Intercept  task  Is  defined  by  the  angle  of  the 
Intercept  and  the  displacement  of  the  two  aircraft.  Figure  7-5  Illustrates  the 
basic  task.  The  Intercept  angle  Is  the  relative  angle  between  the  two  aircraft. 
The  displacement  Is  found  by  projecting  the  paths  of  the  two  aircraft  assuming 
no  turn.  The  displacement  Is  determined  by  the  distance  of  each  aircraft 
relative  to  the  point  of  Intercept  of  the  two  aircraft  trajectories.  To 
II lustrate,  assume  you  have  two  aircraft  A  and  B.  At  the  point  that  aircraft  B 
crosses  the  path  of  aircraft  A,  aircraft  A  Is  10  nautical  miles  beyond  the  point 
of  path  Intersection.  Hence,  the  displacement  for  aircraft  A  would  be  plus  10 
nautical  miles.  Being  able  to  estimate  these  two  parameters  of  an  Intercept  Is 
critical  for  Identifying  the  solution  space  (see  Stages  6  and  7).  The 
operator's  task  Is  presented  In  Figure  7-5.  After  being  presented  the  two 
aircraft,  the  operator  must  specify  the  Intercept  angle  and  the  displacement  of 
the  two  aircraft.  The  trial  will  be  considered  correct  If  the  Intercept  angle 
was  specified  correctly  (within  10  degrees),  and  the  temporal  displacement  was 
specified  within  5%.  On  correct  trials,  the  two  aircraft  will  fly  the  specified 
trajectories  at  200  times  the  real  speed  (about  .5  second).  On  Incorrect  trials 
the  specified  Intercept  will  be  displayed  dimly.  The  correct  angle  and 
displacement  will  be  highlighted  on  the  screen  with  spoken  correct  answers.  The 
operator  will  have  to  enter  the  angle  and  displacement  If  these  were  In  error. 
The  performance  criterion  will  be  90|t  accuracy  with  3  second  or  less  responses. 
This  stage  Illustrates  Training  Rules  2-8.  Training  time  Is  expected  to  be  600 
trials  or  2  hours. 
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Stage  6  --  Solution  space  §s.  A  function  Qt  angle  and.  strategy .  The  goal  of 
this  stage  Is  to  teach  the  operator  to  visual Ize  the  solution  space  for  each 
strategy  at  different  angles  of  intercepts.  There  are  eight  strategies  as 
illustrated  In  Table  2.  The  strategies  depend  on  whether  or  not  each  aircraft 
is  turning  port  or  starboard  and  whether  aircraft  1  Intercepts  aircraft  2  while 
It  is  on  the  turn  or  vice  versa,  thus  giving  a  2  by  2  by  2  set  of  strategies. 
Figures  Illustrates  the  solution  space  for  Strategy  6  (Starboard  turn  aircraft 
B,  port  turn  aircraft  A,  aircraft  A  Intercepts  aircraft  B  while  aircraft  B  Is 
still  In  the  turn).  As  the  angle  of  Intercept  changes  from  30  to  180  degrees,  a 
set  of  solutions  moves  from  the  lower  center  corner  toward  the  center  left  of 
the  display.  Presented  on  a  dynamic  computer  display,  the  operator  can  observe 
how  the  space  Is  deformed  when  moving  from  one  angle  to  another. 


Insert  Figure  8  about  here 


The  human  ability  to  perform  spatial  operations  on  complex  displays  Is  both 
fast  and  quite  accurate.  For  example.  Cooper  (1975)  showed  that  subjects  could 
accurately  rotate  21  point  polygons  through  50  degrees  In  a  tenth  of  a  second  In 
order  to  compare  complex  shapes.  She  also  found  that  there  was  little  change  In 
rotation  speed  as  the  complexity  of  the  shapes  Increased.  Results  suggest  that 
humans  are  capable  of  performing  spatial  rotations  of  complex  figures  In  3 
dimensions  at  rapid  rates.  The  purpose  of  the  present  training  stage  Is  to 
develop  such  complex  spatial  transformation  capabilities  for  rendezvous  solution 
spaces. 

The  operator  will  be  trained  to  deform  the  solution  space  for  each  strategy 
In  order  to  determine  whether  a  particular  point  appears  on  that  solution  space. 
The  training  Is  done  for  each  of  the  strategies  Individually.  This  Is  because 
the  transformations  of  the  Individual  strategy  solution  spaces  are  well  behaved, 
whereas  the  eight  combined  spaces  are  not.  In  this  context,  a  well  behaved 
transformation  Implies  that  a  single  simple  rule  defines  how  the  space  Is 
transformed  as  the  angle  changes.  For  example.  In  Figure  8  the  transformation 
Is  a  movement  of  the  solution  space  towards  the  center  and  towards  the  left. 
Since  different  strategies  operate  under  different  transformation  rules.  It 
would  be  more  difficult  to  have  an  operator  transform  the  total  space  of  eight 
solution  strategies  as  the  angle  changes.  For  this  reason  the  operator  Is 
trained  to  transform  the  solution  space  for  each  Individual  strategy. 

Figure  7-6  Illustrates  the  basic  task.  The  operator  Is  presented  the  two 
aircraft  and  the  solution  space  for  a  I  I  the  possible  Intercepts  for  one  of  the 
strategies.  One  of  the  aircraft  then  rotates  maintaining  a  fixed  distance  of 
Intercept.  As  the  aircraft  rotates  the  solution  space  Is  updated  for  each 
possible  angle  of  Intercept.  The  operator  will  observe  the  spatial  rotation 
through  a  360  degree  range  during  a  6  second  period.  Thereafter  the  operator 
will  be  presented  a  series  of  10  test  Intercept  points  (7-6A).  A  displacement 
test  Intercept  will  present  the  two  starting  positions  of  the  aircraft  and  a 
potential  final  rendezvous  point,  with  the  correct  heading,  that  could  be  either 
too  early  or  too  late.  The  operator  must  quickly  decide  whether  the  test 
position  is  too  far  or  near.  In  a  similar  manner  the  angle  test  Intercept  will 
present  the  Intercept  at  the  proper  point  but  the  angle  will  be  either  too  small 
or  too  large.  After  the  operator  has  become  accurate  at  detecting  rendezvous 
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which  are  presented  directly  on  the  solution  space,  rendezvous  which  are  seme 
distance  away  from  the  solution  space  will  also  be  tested  (7-6B).  For  this 
test,  the  operator  Is  expected  to  Identify  whether  the  two  aircraft  could  have 
rendezvoused  and  maintained  heading  up  to  the  specified  point  on  the  display. 

The  performance  feedback  on  correct  responses  will  Include  displaying  the 
solution  space,  and  having  the  two  aircraft  perform  the  appropriate  rendezvous 
In  fast  time  (e.g.,  1  second).  On  error  trials  the  solution  space  and  test 
point  will  be  presented.  The  estimated  training  time  Is  1600  trials  or  200 
trials  per  strategy.  This  would  require  about  6  hours. 

This  stage  illustrates  Rule  1  by  consistently  presenting  the  solution  space 
to  the  operator.  For  any  particular  intercept  angle  there  are  many  possible 
solutions  to  the  problem.  For  example.  In  Figure  8  there  are  ten  possible 
solutions  to  the  90  degree  intercept  problem  for  a  strategy  6  Intercept.  When 
the  problem  Is  represented  at  the  level  of  the  solution  space,  each  time  the  90 
degree  Intercept  appears  the  same  set  of  ten  potential  rendezvous  points  are 
available.  By  consistently  presenting  the  full  set  of  ten  possible  solutions, 
the  operator  Is  expected  to  develop  a  template  for  this  particular  strategy  of 
solution.  Because  the  strategy  Is  presented  consistently,  the  operator  should 
gain  an  ability  to  automatically  generate  that  template.  Note  the  strong 
contrast  between  training  solution  spaces  by  presenting  them  to  the  operator 
relative  to  the  traditional  method  of  presenting  the  operator  Individual 
solutions  (particular  rendezvous).  The  30  degree  Intercept  problem  has  100 
potential  solutions  (see  Figure  4).  It  Is  unlikely  that  an  operator  presented 
the  Individual  solutions  would  be  able  to  Identify  the  consistency  of  the 
solution  spaces  for  each  of  the  strategies.  Due  to  memory  decay  problems  the 
operator  could  not  Integrate  over  100  Individual  ly  presented  solutions.  By 
training  the  operator  to  explicitly  Identify  solution  spaces.  It  Is  believed 
that  this  critical  component  skill  can  become  automatic.  By  testing  the 
operator's  ability  to  manipulate  his  space,  we  can  require  the  operator  to 
examine  the  total  solution  space  about  200  times  per  strategy  In  a  6  hour 
training  period.  If  we  were  to  present  the  same  Information  by  examining 
Individual  solutions,  this  training  phase  would  require  72  hours  of  training  at 
high  speed  presentations  and  4600  hours  at  real  time  training  speeds.  Training 
the  operator  to  deal  with  solution  spaces  presents  the  Information  consistently 
at  the  level  at  which  the  operator  must  deal  with  the  Information,  condenses  a 
great  deal  of  Information  Into  each  display,  and  trains  the  operator  at 
performing  the  critical  component  task  of  Identifying  the  possible  location  of 
the  solution. 


Stage  7  —  IdpntLfyJng  SfllutJfiP  SS.  S.  fmictlop  Ql  changing  spatial 
displacement.  The  goal  of  this  stage  is  similar  to  stage  6  except  that  the 
temporal  displacement  of  the  Intercept  Is  changed,  rather  than  changing  the 
angle  of  the  Intercept.  Figure  7-7  shows  the  basic  task.  One  of  the  aircraft 
now  moves  forward  and  backward  along  Its  trajectory.  As  the  displacement  of  the 
two  aircraft  change,  the  solution  space  for  a  given  strategy  Is  deformed.  The 
training  In  this  stage  Is  equivalent  to  that  of  Stage  6.  Initial  training  will 
test  operators  with  a  prototypical  (90  degree)  Intercept.  After  Initial 
training  each  trial  will  present  a  different  angle  of  intercept  and  a  range  of 
displacements.  The  estimated  training  time  Is  2100  trials  or  about  8  hours. 
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Stage  8  ~  Running  comp  1 ete  Intercepts.  The  purpose  of  this  stage  Is  to 
perform  complete  Intercepts  on  a  task  given  appropriate  constraints.  In  this 
task  the  operator  Is  presented  the  two  aircraft  and  required  to  carry  out  the 
Intercept  (see  Figure  7-8).  There  are  three  constraints  the  operator  must 
consider  for  specific  rendezvous  tests.  These  are  the  heading,  location  of  the 
rendezvous,  and  strategy  (I.e.,  direction  of  turn  of  the  two  aircraft  and  which 
Intercepts  the  other).  In  Test  A  the  operator  would  be  given  the  rollout 
heading,  the  strategy,  the  location  of  the  Intercept  and  be  required  to  Indicate 
the  start  of  the  turn  of  each  aircraft.  In  Test  B  the  operator  would  be  given 
the  strategy  and  the  rol lout  angle  and  be  required  to  determine  the  location  of 
the  Intercept  and  specify  the  start  of  the  turn.  In  Test  C  the  operator  would 
be  given  the  angle  and  be  required  to  specify  the  strategy,  the  location  of  the 
rendezvous,  and  the  start  of  the  turn  of  the  two  aircraft.  In  Test  D  the 
operator  would  be  given  the  final  location  of  the  rendezvous  and  be  required  to 
specify  the  stratey,  the  rol lout,  angle  and  the  location  of  the  start  of  the 
turns.  In  Test  E  the  operator  would  be  given  the  final  location  and  the 
strategy  and  be  required  to  specify  the  angle  and  the  start  of  turns  of  the  two 
aircraft.  On  half  the  trials  (Tests  A  -  E)  the  operator  will  be  given  component 
feedback  Indicating  their  accuracy  on  each  component  of  the  task.  If  for 
example  the  operator  enters  the  wrong  rollout  heading,  the  computer  will  provide 
the  operator  feedback  Indicating  the  correct  heading  before  the  operator  moves 
to  the  stage  of  specifying  the  start  of  the  turns.  On  the  other  half  of  the 
trials,  feedback  will  be  presented  only  after  the  total  rendezvous  has  been 
specified.  On  correct  trials  the  strategy  solution  space  will  be  dimly  lit  and 
the  two  aircraft  will  run  the  appropriate  rendezvous.  On  Incorrect  trials  the 
proper  solution  will  be  presented  and  the  operator  must  specify  the  parameters 
of  that  solution.  This  training  stage  Illustrates  Rules  1-9.  The  criterion  for 
moving  to  the  next  stage  would  be  a  95$  accuracy  of  specifying  the  appropriate 
Intercepts. 

Stage  9  —  Testing  under  high  secondary  task  load.  The  goal  of  this  stage 
is  to  test  whether  the  component  tasks  can  be  performed  under  high  secondary 
task  load.  This  Is  to  assess  whether  performance  has  become  automatic  enough  to 
be  presumed  reliable  In  an  operational  environment.  The  task  Is  the  same  as 
Stage  8B  except  the  operator  performs  a  secondary  task.  The  operator  will  be 
required  to  perform  a  digit  cancel  ling  task  at  the  same  time  as  executing  the 
rendezvous.  The  operator  will  hear  a  series  of  digits  presented  over  the 
headset.  The  operator  will  be  required  to  verbalize  the  digit  that  was 
presented  two  digits  back.  For  example  the  operator  will  hear  the  sequence  of 
8,  5,  3,  9,  2.  When  the  operator  hears  the  digit  3  he  would  respond  8,  after 
hearing  the  digit  9  he  would  respond  5,  after  hearing  the  digit  2  respond  3,  In 
each  case  responding  with  the  digit  which  Is  two  digits  back.  Testing  will  be 
alternated  between  trials  with  and  without  the  concurrent  digit  cancelling  task. 
The  accuracy  criterion  will  be  that  performance  will  decrement  no  more  than  10$ 
with  the  concurrent  digit  cancelling  task.  The  estimated  training  time  would  bo 
900  trials  at  16  seconds  a  trial  or  6  hours. 

This  task  Illustrates  Rule  10  In  the  use  of  secondary  tasks  to  assess 
performance  competence.  When  the  operator  Is  trained  to  periPorm  wo I  I  even  under 
high  secondary  task  load,  his  or  her  efficiency  In  a  field  environment  Is  likely 
to  be  much  higher.  In  contrast  to  the  teaching  environment,  the  field 
environment  typical ly  puts  the  operator  under  very  high  work  load.  This  stage 
Is  Intended  to  train  the  operator  to  perform  the  task  with  substantially  reduced 
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resources  available  for  the  task. 

Stage  10  —  Transfer  to  the  real  time  rendezvous  task.  The  purpose  of  this 
stage  Is  to  transfer  the  operator  to  performing  the  task  at  real  time  speed. 
All  of  the  training  up  to  this  point  typically  presented  the  task  to  the 
operator  at  least  60  times  real  time  speed.  What  the  operator  observed 
happening  In  1  second  typically  required  1  minute  In  the  operational 
environment.  In  Stages  1  -  9  this  speed  up  presentation  had  the  advantages  of 
presenting  many  more  trials,  minimizing  memory  decay,  and  maintaining  operator 
motivation.  However,  It  Is  necessary  to  move  to  the  real  environment  In  which 
things  happen  relatively  very  slowly.  The  task  here  Is  the  same  as  In  Stage  8B 
except  for  the  slowing.  The  operator  will  perform  1  trial  at  real  time  and  10 
trials  at  high  speed.  The  expectation  Is  that  there  will  be  near  perfect 
transfer  from  the  high  speed  training  to  the  slow  speed  task.  This  Is  because 
the  operator  Is  trained  to  perform  the  task  as  a  spatial  task  rather  than  a 
temporal  task.  The  estimated  training  time  Is  20  trials  at  the  slow  speed  of 
600  seconds  and  100  trials  at  the  high  speed  of  12  seconds  for  a  total  of  4 
hours. 

The  above  ten  stage  training  program  Illustrates  how  one  might  use 
microcomputer  control  trainers  to  develop  automatic  component  skills  to  perform 
a  complex  control  task.  It  Is  expected  that  the  above  40  hour  training  program 
would  substantially  enhance  controllers'  ability  In  comparison  to  current 
traditional  training  methods.  Table  3  Illustrates  the  basic  stages  of  this 
training  program  and  the  number  of  trials  In  which  the  operator  will  perform  the 
component  skills  In  each  stage.  In  order  to  make  a  component  skill  automatic 
the  operator  must  experience  hundreds  and  perhaps  thousands  of  trials  of 
practice  at  each  component.  Using  the  above  rules  and  tuning  the  training 
program  It  Is  quite  possible  to  present  the  operator  thousands  of  trials  of 
practice  at  each  of  the  component  tasks  even  during  a  short  training  program 
(e.g.,  40  hours).  Given  that  the  operator  can  consistently  deal  with  the  task, 
receives  thousands  of  trials  of  training,  and  maintains  motivated  performance 
throughout  that  training.  It  Is  expected  that  the  operator  will  develop 
substantial  automatic  component  skills  to  perform  the  alr-traffic  control  task. 


Insert  Table  3  about  here 


It  Is  useful  to  contrast  what  the  operator  would  experience  under  the 
proposed  training  method  relative  to  current  military  training  programs.  In  the 
current  military  training  programs,  the  operator  Is  trained  basically  to  perform 
Intercepts  In  real  time  situations.  The  operator  could  be  expected  to 
experience  120  Intercepts  In  a  40  hour  period  (however  In  practice  the  actual 
number  of  Intercepts  per  week  Is  far  less).  The  operator  would  have  no 
experience  In  performing  solution  space  transformations  or  at  performing  the 
task  under  particuarly  high  work  load.  The  operator  would  of  course  have  more 
experience  at  slow  Intercepts  In  the  traditional  method  relative  to  the  new 
method  (120  versus  20).  Because  training  In  real  time  results  In  very  severe 
memory  decay,  presents  to  the  operator  relatively  few  trials,  does  not  present 
the  Information  consistently,  and  may  not  maintain  substantial  motivation.  It  Is 
unlikely  that  the  traditional  training  method  could  develop  automatic  component 
skills.  Certainly  present  methods  could  not  develop  such  skills  In  a  40  hour 


Table  3 

Proposed  ATC  for  Inflight  Refueling  Training  Program 


Current 

Methods 


Stage  1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

TOT 

Tot/cur 

Hours  of  training  1 

1 

2 

2 

2 

6 

8 

8 

6 

4 

40 

40 

Skill 

Angle  identification  1080 

600 

1000 

2100 

900 

120 

5800 

120 

Start  turn 

600 

1000 

1000 

2100 

900 

120 

5720 

120 

Length  Estimation 

1000 

2100 

900 

120 

5720 

120 

Intercept  angle 

600 

2100 

900 

120 

3720 

120 

Distance  Displacement 

600 

2100 

900 

120 

3720 

120 

Solution  space  angle  transform 

1600 

2100 

900 

120 

4720 

0 

Solution  space  spatial  transform 

2100 

2100 

900 

120 

5420 

0 

Full  Intercepts 

2100 

900 

120 

3120 

120 

Dual  Task  Intercepts 

20 

20 

0 

Slow  Intercepts  (real  time) 

20 

20 

120 

TOT  -  refers  to  the  total  number  of  executions  of  each  component  ski  1 1 
using  the  proposed  training  method. 

Tot/cur  -  refers  to  the  total  number  of  executions  of  each  component 
using  traditional  training  methods. 
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training  program.  Should  operators  learn  as  much  per  trial  In  th«  proposed 
training  program  as  they  do  In  the  traditional  training  program,  the  proposed 
training  program  would  be  26  times  more  efficient.  We  do  not  presently  have  the 
data  to  allow  us  to  estimate  what  the  true  efficiency  of  the  two  training 
programs  might  be.  However,  the  fact  that  operators  learn  primarily  from 
consistent  correct  executions  and  learn  more  If  there  Is  less  memory  decay, 
suggests  that  operators  might  actually  learn  more  per  trial  In  the  proposed  than 
In  the  traditional  training  program. 

The  proposed  training  program  Is  still  a  hypothetical  training  program 
operating  In  a  basic  research  laboratory.  The  above  program  Illustrates  that  by 
carefully  training  component  skills  one  can  expect  that  automatic  performance 
levels  could  be  achieved  In  complex  real  world  environments.  The  observance  of 
the  11  rules  of  skill  development  resulted  In  a  novel  approach  to  the  training 
of  this  task.  Theoretical  work  suggests  that  substantial  performance 
Improvements  can  be  obtained  by  careful  analysis  of  complex  tasks  and 
Identification  of  methods  of  representing  the  task.  Future  research  will 
explore  the  effectiveness  of  the  training  rules  for  speeding  perceptual  learning 
of  the  complex  alr-traffic  control  task.  We  feel  the  rules  may  speed 
development  of  skills  In  a  wide  variety  of  tasks  (e.g.,  reading,  typing, 
aircraft  control). 
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Technical  Reports  and  Working  Papers 
I.  Technical  Reports 

8001  Schneider,  W.,  &  Fisk,  A.  D.  Independence  of  foveal  retinal  locus  and 
visual  detection  paradigm. 

8002  Schneider,  W.,  i  Fisk,  A.  D.  Dual  task  automatic  and  controlled  processing 
In  visual  search,  can  It  be  done  without  cost? 

8003  Eberts,  R.,  &  Schneider,  W.  The  automatic  and  controlled  processing  of 
temporal  and  spatial  patterns. 

8004  Schneider,  W.,  t,  Fisk,  A.  0.  Visual  search  Improves  with  detection 
searches,  declines  with  nondetection  search. 

8005  Schneider,  W.,  &  Fisk,  A.  D.  Degree  of  consistent  training  and  the 
development  of  automatic  processing. 

8006  Fisk,  A.  D.,  &  Schneider,  W.  Controlled  and  automatic  processing  during 
tasks  requiring  sustained  attention:  A  new  approach  to  vigilance. 

8007  Fisk,  A.  D.,  &  Schneider,  W.  On  the  learning  of  distractors  during 
controlled  and  automatic  processing. 

8006  Schneider,  W.,  &  Eberts,  R.  Automatic  processing  and  the  unitization  of 
two  features. 

8101  Schneider,  W.  Automatic/control  processing  concepts  and  their  Implications 
for  the  training  of  skills. 

8102  Ackerman,  P.  L.,  Schneider,  W.,  &  WIckens,  C  T.  Individual  differences 
and  time-sharing  ability;  A  critical  review  -nd  analysis. 

8103  Fisk,  A.  D.,  &  Schneider,  W.  Category  and  word  search;  Generalizing 

search  principles  to  complex  processing. 

8104  Schneider,  W.,  Oumals,  S.  T.,  A  Shiffrin,  R.  M.  Automatic/control 

processing  and  attention. 

8105  Fisk,  A.  D.,  Derrick,  W.  L.,  &  Schneider,  W.  The  use  of  dual  task 

paradigms  In  memory  research;  A  methodological  assessment  and  an 

evaluation  of  effort  as  a  measure  of  levels  of  processing. 

8106  Fisk,  A.  D.,  &  Schneider,  W.  Task  versus  component  consistency  In  the 
development  of  automatic  processes:  Consistent  attending  versus  consistent 
responding. 
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8009  Schneider,  W.,  &  Fisk,  A.  D.  Context  dependent  automatic  processing. 

8010  Schneider,  W.,  &  Fisk,  A.  D.  On  the  concept  of  consistency  for  development 

of  automatic  processing:  Consistent  attending  versus  consistent 

responding. 

8011  Schneider,  W.,  Fisk,  A.  D.,  &  Coleman,  W.  On  the  relationship  between 
processing  time  and  development  of  automatic  processing. 

80-1  Schneider,  W. ,  &  Fisk,  A.  D.  Single  versus  multiple  frame  training  and  the 
development  of  automatic  processing  In  visual  search. 

80-2  Schneider,  W.,  &  Fisk,  A.  D.  Distribution  of  consistent  training:  Is  It 
an  Important  factor  for  rate  of  automatic  processing  development. 

80-3  Fisk,  A.  D.,  Derrick,  W.,  &  Schneider,  W.  Mental  effort,  task  appropriate 
controlled  processing,  and  the  adequacy  of  processing  resources  as  an  Index 
of  levels  of  processing. 

80-4  Schneider,  W.,  &  Eberts,  R.  Consistency  at  multiple  levels  In  sequential 
motor  output  processing. 
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